Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-6bda55-openshift-default-757659f87-x82c7 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x to ip-10-0-137-228.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-sdrvk

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-sdrvk to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8 to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8 to ip-10-0-129-133.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-snzms

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-snzms to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s to ip-10-0-137-228.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-xhs8n to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59 to ip-10-0-129-133.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5 to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88 to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-pdt6z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-pdt6z to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn to ip-10-0-129-133.ec2.internal

kuadrant-system

authorino-65c6d4fc99-x6wdt

Scheduled

Successfully assigned kuadrant-system/authorino-65c6d4fc99-x6wdt to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr to ip-10-0-129-133.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq to ip-10-0-129-133.ec2.internal

kuadrant-system

authorino-65db9f99d7-l7q4s

Scheduled

Successfully assigned kuadrant-system/authorino-65db9f99d7-l7q4s to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx to ip-10-0-137-228.ec2.internal

openshift-ingress

kube-auth-proxy-dc45784b6-l4s7t

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-dc45784b6-l4s7t to ip-10-0-129-133.ec2.internal

kuadrant-system

authorino-74ccc46849-fttc6

Scheduled

Successfully assigned kuadrant-system/authorino-74ccc46849-fttc6 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf to ip-10-0-137-228.ec2.internal

kuadrant-system

authorino-74db894f99-ks6w4

Scheduled

Successfully assigned kuadrant-system/authorino-74db894f99-ks6w4 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7a04e002-openshift-default-6669855c89-92fw5 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2 to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz to ip-10-0-137-228.ec2.internal

kuadrant-system

authorino-7597569d74-g74pm

Scheduled

Successfully assigned kuadrant-system/authorino-7597569d74-g74pm to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq to ip-10-0-129-133.ec2.internal

openshift-ingress

kube-auth-proxy-dc45784b6-t2t85

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-dc45784b6-t2t85 to ip-10-0-137-228.ec2.internal

kuadrant-system

authorino-8fd5b54-cwv87

Scheduled

Successfully assigned kuadrant-system/authorino-8fd5b54-cwv87 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5431fa34-openshift-default-6685769f9-p95b7 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7a04e002-openshift-default-6669855c89-988sj to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt to ip-10-0-142-36.ec2.internal

openshift-jobset-operator

jobset-controller-manager-6c944f4b6d-zl7n2

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-6c944f4b6d-zl7n2 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-666577-openshift-default-f887989df-gvxxs to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7a04e002-openshift-default-6669855c89-9khb6 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82 to ip-10-0-129-133.ec2.internal

kuadrant-system

authorino-dc8775675-8b2gn

Scheduled

Successfully assigned kuadrant-system/authorino-dc8775675-8b2gn to ip-10-0-129-133.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-wtc5x to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6 to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7 to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9 to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9 to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr to ip-10-0-137-228.ec2.internal

kuadrant-system

authorino-operator-779bff956b-l69xd

Scheduled

Successfully assigned kuadrant-system/authorino-operator-779bff956b-l69xd to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4 to ip-10-0-129-133.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-858f55f4d9t74ft

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d9t74ft to ip-10-0-142-36.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-786cc47469-vr26k

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-786cc47469-vr26k to ip-10-0-137-228.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-786cc47469-kh25x

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-786cc47469-kh25x to ip-10-0-129-133.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-786cc47469-ddlzq

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-786cc47469-ddlzq to ip-10-0-142-36.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-ktflf

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-ktflf to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz to ip-10-0-129-133.ec2.internal

opendatahub

test-curl-7145-f91f9a

Scheduled

Successfully assigned opendatahub/test-curl-7145-f91f9a to ip-10-0-142-36.ec2.internal

opendatahub

test-curl-7145-86b048

Scheduled

Successfully assigned opendatahub/test-curl-7145-86b048 to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk to ip-10-0-129-133.ec2.internal

kuadrant-system

developer-portal-controller-66d8dbb8c8-jxp7q

Scheduled

Successfully assigned kuadrant-system/developer-portal-controller-66d8dbb8c8-jxp7q to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd to ip-10-0-142-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-v7qbw to ip-10-0-137-228.ec2.internal

opendatahub

odh-model-controller-769875db56-n6rkn

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-n6rkn to ip-10-0-142-36.ec2.internal

kuadrant-system

dns-operator-controller-manager-57f5c66455-9g9vc

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-57f5c66455-9g9vc to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx to ip-10-0-137-228.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-b7nrt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-b7nrt to ip-10-0-129-133.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-rmq6s to ip-10-0-137-228.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-gzpff

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-gzpff to ip-10-0-142-36.ec2.internal

kuadrant-system

kuadrant-console-plugin-7bbc6bb9d7-tvp9w

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-7bbc6bb9d7-tvp9w to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6a4499-openshift-default-8677876f85-2m44b to ip-10-0-129-133.ec2.internal

opendatahub

maas-controller-c4696569f-ffktb

Scheduled

Successfully assigned opendatahub/maas-controller-c4696569f-ffktb to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv to ip-10-0-137-228.ec2.internal

opendatahub

maas-controller-5d7d58c6ff-pncqs

Scheduled

Successfully assigned opendatahub/maas-controller-5d7d58c6ff-pncqs to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8 to ip-10-0-137-228.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-nllbj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-nllbj to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6 to ip-10-0-137-228.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-7g9t5

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-6b575997cc-7g9t5 to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf to ip-10-0-129-133.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2w5h to ip-10-0-129-133.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6jqvg to ip-10-0-142-36.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-xvtl9

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-xvtl9 to ip-10-0-142-36.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-gjccx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gjccx to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql to ip-10-0-129-133.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-kfdb7 to ip-10-0-129-133.ec2.internal

kuadrant-system

limitador-limitador-77dd99c685-ffnbm

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-77dd99c685-ffnbm to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm to ip-10-0-137-228.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-z228w

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-z228w to ip-10-0-142-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-f74x8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-f74x8 to ip-10-0-142-36.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-s9qks

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-s9qks to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr to ip-10-0-142-36.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-kvdnb to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-70621c-openshift-default-74bc85477-kvzf4 to ip-10-0-137-228.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-9twbb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-9twbb to ip-10-0-129-133.ec2.internal

kuadrant-system

limitador-limitador-f7d6b5c7c-jbnbk

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-f7d6b5c7c-jbnbk to ip-10-0-129-133.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-5k947

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-5k947 to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d to ip-10-0-129-133.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-p8qh9

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-p8qh9 to ip-10-0-129-133.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-8d5wt to ip-10-0-129-133.ec2.internal

openshift-ingress

router-default-846cf5b65-gllvj

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-846cf5b65-gllvj

FailedScheduling

no nodes available to schedule pods

kuadrant-system

limitador-operator-controller-manager-68669df9c4-2nng6

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-68669df9c4-2nng6 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb to ip-10-0-137-228.ec2.internal

opendatahub

ai-gateway-controller-55f5889bd4-fv926

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-55f5889bd4-fv926 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2 to ip-10-0-137-228.ec2.internal

kuadrant-system

mcp-gateway-controller-6c98b995c5-j98z2

Scheduled

Successfully assigned kuadrant-system/mcp-gateway-controller-6c98b995c5-j98z2 to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff to ip-10-0-137-228.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b to ip-10-0-137-228.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9 to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4 to ip-10-0-129-133.ec2.internal

cert-manager

cert-manager-597b95cb84-xw6zk

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-xw6zk to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn to ip-10-0-129-133.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-fb2pt

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-fb2pt to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn to ip-10-0-129-133.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-pdnxs

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-pdnxs to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9 to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg to ip-10-0-142-36.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq to ip-10-0-137-228.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-z7swk

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-z7swk to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v to ip-10-0-129-133.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-8wtq4

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-8wtq4 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4 to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2 to ip-10-0-129-133.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-vhr7q to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-hv6zx

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-hv6zx to ip-10-0-129-133.ec2.internal

openshift-ingress

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9 to ip-10-0-137-228.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq to ip-10-0-129-133.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz to ip-10-0-129-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9 to ip-10-0-137-228.ec2.internal

openshift-ingress

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv to ip-10-0-129-133.ec2.internal

openshift-ingress

router-default-846cf5b65-gllvj

Scheduled

Successfully assigned openshift-ingress/router-default-846cf5b65-gllvj to ip-10-0-142-36.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-5fwdk to ip-10-0-142-36.ec2.internal

openshift-ingress

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

Scheduled

Successfully assigned openshift-ingress/e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd to ip-10-0-137-228.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-846cf5b65 from 0 to 1

openshift-ingress

replicaset-controller

router-default-846cf5b65

SuccessfulCreate

Created pod: router-default-846cf5b65-gllvj

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-846cf5b65-gllvj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-846cf5b65-gllvj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-846cf5b65-gllvj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-846cf5b65-gllvj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-846cf5b65-gllvj

Started

Container started

openshift-ingress

kubelet

router-default-846cf5b65-gllvj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-846cf5b65-gllvj

Created

Container created

openshift-ingress

multus

router-default-846cf5b65-gllvj

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-b7nrt

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-b7nrt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-b7nrt

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-b7nrt

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-b7nrt

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-b7nrt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.119s (2.119s including waiting). Image size: 185476477 bytes.

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-wtc5x

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7d9897b54c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-b7nrt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-b7nrt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-6dd6bfb767 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-6dd6bfb767

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.617s (5.617s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.591s (5.591s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6dd6bfb767-dwgn5

Started

Container started
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-786cc47469-ddlzq

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes
(x5)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-786cc47469

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-786cc47469-ddlzq

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-786cc47469-vr26k

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-786cc47469

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-786cc47469-kh25x

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-786cc47469 from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-786cc47469-kh25x

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-786cc47469

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-786cc47469-vr26k

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-snzms

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-snzms

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-snzms

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x8)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

opendatahub-operator-system

operator-lifecycle-manager

install-lfbhf

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.701s (2.701s including waiting). Image size: 273709574 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Started

Container started

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-sdrvk

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-sdrvk

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.886s (2.886s including waiting). Image size: 273709574 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdrvk

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 348ms (348ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.267s (3.267s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-kh25x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-snzms

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-786cc47469-kh25x_30cd6a4b-68ee-4fa7-a187-7542976f435a

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-786cc47469-kh25x_30cd6a4b-68ee-4fa7-a187-7542976f435a became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 393ms (393ms including waiting). Image size: 273709574 bytes.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-vr26k

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-snzms

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-786cc47469-ddlzq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 340ms (340ms including waiting). Image size: 273709574 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-snzms

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.871s (3.871s including waiting). Image size: 309650901 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdrvk

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdrvk

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdrvk

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.603s (2.603s including waiting). Image size: 309650901 bytes.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-fb2pt
(x9)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-fb2pt

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fb2pt

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

cert-manager

kubelet

cert-manager-597b95cb84-xw6zk

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-xw6zk

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-xw6zk

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-xw6zk

cert-manager

kubelet

cert-manager-597b95cb84-xw6zk

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-6b575997cc

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-6b575997cc-7g9t5

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-6b575997cc from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

kuadrant-operator-controller-manager-6b575997cc-7g9t5

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-7g9t5

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299"
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-7g9t5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:d297423e5507ec7ef5be128004902e3f62b5bf1d97f034d465c12628820ca299" in 4.82s (4.82s including waiting). Image size: 481302115 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-7g9t5

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6b575997cc-7g9t5

Started

Container started
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fb2pt

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fb2pt

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fb2pt

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 10.034s (10.034s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-fb2pt_d793c2bf-7676-4930-8a4e-929430ad6180 became leader

kuadrant-system

kuadrant-operator-controller-manager-6b575997cc-7g9t5_418ec26e-5e78-4011-b223-ddb07357d528

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-6b575997cc-7g9t5_418ec26e-5e78-4011-b223-ddb07357d528 became leader

kuadrant-system

replicaset-controller

mcp-gateway-controller-6c98b995c5

SuccessfulCreate

Created pod: mcp-gateway-controller-6c98b995c5-j98z2

kuadrant-system

replicaset-controller

dns-operator-controller-manager-57f5c66455

SuccessfulCreate

Created pod: dns-operator-controller-manager-57f5c66455-9g9vc

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-57f5c66455 from 0 to 1

kuadrant-system

deployment-controller

mcp-gateway-controller

ScalingReplicaSet

Scaled up replica set mcp-gateway-controller-6c98b995c5 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-68669df9c4

SuccessfulCreate

Created pod: limitador-operator-controller-manager-68669df9c4-2nng6

kuadrant-system

replicaset-controller

authorino-operator-779bff956b

SuccessfulCreate

Created pod: authorino-operator-779bff956b-l69xd

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-779bff956b from 0 to 1

kuadrant-system

multus

authorino-operator-779bff956b-l69xd

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

multus

mcp-gateway-controller-6c98b995c5-j98z2

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-68669df9c4 from 0 to 1

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-j98z2

Pulling

Pulling image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa"

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-9g9vc

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388"

kuadrant-system

multus

dns-operator-controller-manager-57f5c66455-9g9vc

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-779bff956b-l69xd

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402"

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-jxp7q

Pulling

Pulling image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90"

kuadrant-system

deployment-controller

developer-portal-controller

ScalingReplicaSet

Scaled up replica set developer-portal-controller-66d8dbb8c8 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-7bbc6bb9d7

SuccessfulCreate

Created pod: kuadrant-console-plugin-7bbc6bb9d7-tvp9w

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-2nng6

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3"

kuadrant-system

multus

limitador-operator-controller-manager-68669df9c4-2nng6

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

multus

developer-portal-controller-66d8dbb8c8-jxp7q

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-7bbc6bb9d7 from 0 to 1

kuadrant-system

replicaset-controller

developer-portal-controller-66d8dbb8c8

SuccessfulCreate

Created pod: developer-portal-controller-66d8dbb8c8-jxp7q

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-j98z2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/mcp-gateway-rhel9-operator@sha256:ac8b4d4c78cf24a7a5ee12de4cdc89b7f24bbb6c02e36798e74d81e5b3e9aefa" in 1.928s (1.928s including waiting). Image size: 158458620 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-tvp9w

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b"

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-j98z2

Started

Container started

kuadrant-system

kubelet

mcp-gateway-controller-6c98b995c5-j98z2

Created

Container created

kuadrant-system

multus

kuadrant-console-plugin-7bbc6bb9d7-tvp9w

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-2nng6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:d81c7c651171a924b50b8df3cf7934a0d98de9057bdf92a50f5acfaf4f4283f3" in 3.21s (3.21s including waiting). Image size: 178063410 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-9g9vc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:5c642fccff0a02ad72a6354fe44695e87cca8903a8713c412e995cfe6f9ca388" in 4.754s (4.754s including waiting). Image size: 192755988 bytes.

kuadrant-system

limitador-operator-controller-manager-68669df9c4-2nng6_4cfdac51-69c6-480a-92e6-933b476bdb34

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-68669df9c4-2nng6_4cfdac51-69c6-480a-92e6-933b476bdb34 became leader

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-jxp7q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/developer-portal-controller-rhel9@sha256:66b1656100087f5949d910e839422f75c3030bcbdffb6b79812d0518c54f8f90" in 3.149s (3.149s including waiting). Image size: 190254564 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-tvp9w

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:5174bcdc4785e85d8bf5697c7000f92b08b18efafae3d1d008256909dda2441b" in 2.693s (2.693s including waiting). Image size: 120696640 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-2nng6

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-68669df9c4-2nng6

Started

Container started

kuadrant-system

kubelet

authorino-operator-779bff956b-l69xd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:dd4629ca035b962fce6871fcab1e5e54bc24312a952fe0454a657c18b9b29402" in 3.912s (3.912s including waiting). Image size: 167835888 bytes.

kuadrant-system

developer-portal-controller-66d8dbb8c8-jxp7q_4071ac23-7cd7-4c38-b8df-a70a490d82f2

6dd6d79d.kuadrant.io

LeaderElection

developer-portal-controller-66d8dbb8c8-jxp7q_4071ac23-7cd7-4c38-b8df-a70a490d82f2 became leader

kuadrant-system

kubelet

authorino-operator-779bff956b-l69xd

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.5.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

authorino-operator-779bff956b-l69xd_1584c982-7c47-496e-8955-cf1981e6a9dc

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-779bff956b-l69xd_1584c982-7c47-496e-8955-cf1981e6a9dc became leader

kuadrant-system

dns-operator-controller-manager-57f5c66455-9g9vc_86af6400-b6b4-4d3f-8ec8-a90b3db8c187

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-57f5c66455-9g9vc_86af6400-b6b4-4d3f-8ec8-a90b3db8c187 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-9g9vc

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-57f5c66455-9g9vc

Created

Container created

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-jxp7q

Started

Container started

kuadrant-system

kubelet

authorino-operator-779bff956b-l69xd

Created

Container created

kuadrant-system

kubelet

developer-portal-controller-66d8dbb8c8-jxp7q

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-tvp9w

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-7bbc6bb9d7-tvp9w

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-n9x24"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-dc45784b6 from 0 to 2

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-77dd99c685 from 0 to 1

openshift-ingress

replicaset-controller

kube-auth-proxy-dc45784b6

SuccessfulCreate

Created pod: kube-auth-proxy-dc45784b6-t2t85

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-ingress

replicaset-controller

kube-auth-proxy-dc45784b6

SuccessfulCreate

Created pod: kube-auth-proxy-dc45784b6-l4s7t

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-ingress

multus

kube-auth-proxy-dc45784b6-l4s7t

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-858f55f4d9 from 0 to 1

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-c626n"

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulCreate

Created pod: limitador-limitador-77dd99c685-ffnbm

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-858f55f4d9

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-858f55f4d9t74ft

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-858f55f4d9t74ft

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-dc45784b6-t2t85

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-74ccc46849 from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-858f55f4d9t74ft

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-858f55f4d9t74ft

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-858f55f4d9t74ft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-l4s7t

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulCreate

Created pod: authorino-74ccc46849-fttc6

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

limitador-limitador-77dd99c685-ffnbm

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-t2t85

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

multus

limitador-limitador-77dd99c685-ffnbm

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-77dd99c685-ffnbm

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

authorino-74ccc46849-fttc6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

multus

authorino-74ccc46849-fttc6

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-77dd99c685-ffnbm

Created

Container created

kuadrant-system

kubelet

limitador-limitador-77dd99c685-ffnbm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 1.251s (1.251s including waiting). Image size: 134933837 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-l4s7t

Started

Container started

kuadrant-system

multus

authorino-dc8775675-8b2gn

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-f7d6b5c7c from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-t2t85

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.354s (2.354s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

authorino-dc8775675-8b2gn

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-6c944f4b6d

SuccessfulCreate

Created pod: jobset-controller-manager-6c944f4b6d-zl7n2

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-dc8775675 from 0 to 1

kuadrant-system

multus

limitador-limitador-f7d6b5c7c-jbnbk

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-f7d6b5c7c

SuccessfulCreate

Created pod: limitador-limitador-f7d6b5c7c-jbnbk

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-6c944f4b6d from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-t2t85

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-t2t85

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-l4s7t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.318s (2.318s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-dc45784b6-l4s7t

Created

Container created

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulCreate

Created pod: authorino-dc8775675-8b2gn

openshift-jobset-operator

multus

jobset-controller-manager-6c944f4b6d-zl7n2

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-6c944f4b6d-zl7n2

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-s9qks

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-jbnbk

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa"

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-s9qks

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-s9qks

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-jbnbk

Created

Container created

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-jbnbk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:5ce716d90f7e944720a5d1a6c133d13b1caf6c4f43850778a0d14ea1e395c8aa" in 2.116s (2.116s including waiting). Image size: 134933837 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-6c944f4b6d-zl7n2

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-6c944f4b6d-zl7n2

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.124s (3.124s including waiting). Image size: 182184678 bytes.

kuadrant-system

kubelet

limitador-limitador-f7d6b5c7c-jbnbk

Started

Container started

openshift-jobset-operator

jobset-controller-manager-6c944f4b6d-zl7n2_035ea9d3-4c37-4f5f-917c-6b43bae55fef

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-6c944f4b6d-zl7n2_035ea9d3-4c37-4f5f-917c-6b43bae55fef became leader

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-s9qks

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.242s (2.242s including waiting). Image size: 195729000 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-6c944f4b6d-zl7n2

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-s9qks

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-s9qks

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-74ccc46849 from 1 to 0

kuadrant-system

kubelet

authorino-dc8775675-8b2gn

Started

Container started

kuadrant-system

kubelet

authorino-dc8775675-8b2gn

Created

Container created

kuadrant-system

kubelet

authorino-dc8775675-8b2gn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 8.43s (8.43s including waiting). Image size: 208640811 bytes.

kuadrant-system

replicaset-controller

authorino-74ccc46849

SuccessfulDelete

Deleted pod: authorino-74ccc46849-fttc6

kuadrant-system

kubelet

authorino-74ccc46849-fttc6

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-74ccc46849-fttc6

Started

Container started

kuadrant-system

kubelet

authorino-74ccc46849-fttc6

Created

Container created

kuadrant-system

kubelet

authorino-74ccc46849-fttc6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 10.725s (10.725s including waiting). Image size: 208640811 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

limitador-limitador-77dd99c685-ffnbm

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-77dd99c685 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-77dd99c685

SuccessfulDelete

Deleted pod: limitador-limitador-77dd99c685-ffnbm

opendatahub

kserve-module-controller-manager-7566cf5fc8-s9qks_a60e940b-bd7f-4c65-8b11-d20e14455a63

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-s9qks_a60e940b-bd7f-4c65-8b11-d20e14455a63 became leader
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5d7d58c6ff from 0 to 1

opendatahub

replicaset-controller

maas-controller-5d7d58c6ff

SuccessfulCreate

Created pod: maas-controller-5d7d58c6ff-pncqs

opendatahub

replicaset-controller

maas-controller-c4696569f

SuccessfulCreate

Created pod: maas-controller-c4696569f-ffktb

opendatahub

multus

maas-controller-c4696569f-ffktb

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-c4696569f-ffktb

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:38f7584e30726e98edde0f4de4b4f7d9cb8778f465359c6ea003bd6b218f410e"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-c4696569f from 0 to 1

opendatahub

multus

maas-controller-5d7d58c6ff-pncqs

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-c4696569f-ffktb

Started

Container started

opendatahub

kubelet

maas-controller-c4696569f-ffktb

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:38f7584e30726e98edde0f4de4b4f7d9cb8778f465359c6ea003bd6b218f410e" in 2.884s (2.884s including waiting). Image size: 200053271 bytes.

opendatahub

kubelet

maas-controller-c4696569f-ffktb

Created

Container created

opendatahub

kubelet

maas-controller-5d7d58c6ff-pncqs

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:38f7584e30726e98edde0f4de4b4f7d9cb8778f465359c6ea003bd6b218f410e" in 2.673s (2.673s including waiting). Image size: 200053271 bytes.

opendatahub

maas-controller-c4696569f-ffktb_fa9e80bf-d19c-4358-a277-bb3adedac61f

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-c4696569f-ffktb_fa9e80bf-d19c-4358-a277-bb3adedac61f became leader

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-ktflf

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-ktflf

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ktflf

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

replicaset-controller

maas-controller-c4696569f

SuccessfulDelete

Deleted pod: maas-controller-c4696569f-ffktb

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-c4696569f from 1 to 0

opendatahub

kubelet

maas-controller-c4696569f-ffktb

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ktflf

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ktflf

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ktflf

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.533s (10.533s including waiting). Image size: 1089502687 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-kfdb7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

Created

Container created

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-xvtl9

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-n6rkn

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

kserve-controller-manager-776cc66d47-5k947

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-5k947

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

model-serving-api-75bd89fdfc-gzpff

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-gzpff

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-5k947

opendatahub

multus

odh-model-controller-769875db56-n6rkn

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

opendatahub

multus

model-serving-api-75bd89fdfc-gzpff

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-n6rkn

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xvtl9

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-xvtl9

opendatahub

kubelet

kserve-controller-manager-776cc66d47-5k947

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xvtl9

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xvtl9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.88s (2.88s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-5k947

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.025s (3.025s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-gzpff

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.395s (2.395s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-gzpff

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-gzpff

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-5k947

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xvtl9

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-n6rkn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.311s (3.311s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-n6rkn

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-n6rkn

Started

Container started

opendatahub

odh-model-controller-769875db56-n6rkn_62b86f58-a130-41e0-a6ef-92b956d99b0e

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-n6rkn_62b86f58-a130-41e0-a6ef-92b956d99b0e became leader

opendatahub

kserve-controller-manager-776cc66d47-5k947_94432bb2-8e6a-447c-b14a-4f210fb22278

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-5k947_94432bb2-8e6a-447c-b14a-4f210fb22278 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-xvtl9_4de92dee-c046-4bc7-a1ec-718efd6d33f5

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-xvtl9_4de92dee-c046-4bc7-a1ec-718efd6d33f5 became leader
(x4)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-b7nrt

Killing

Stopping container discovery

opendatahub

maas-controller-5d7d58c6ff-pncqs_275b8c7f-5254-412e-b083-15840c5e596c

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5d7d58c6ff-pncqs_275b8c7f-5254-412e-b083-15840c5e596c became leader

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-b7nrt

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

ProbeError

Readiness probe error: Get "http://10.132.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Unhealthy

Readiness probe failed: Get "http://10.132.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

ProbeError

Startup probe error: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Unhealthy

Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused

kuadrant-system

replicaset-controller

authorino-65db9f99d7

SuccessfulCreate

Created pod: authorino-65db9f99d7-l7q4s

kuadrant-system

replicaset-controller

authorino-74db894f99

SuccessfulCreate

Created pod: authorino-74db894f99-ks6w4

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulCreate

Created pod: authorino-7597569d74-g74pm

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-7597569d74 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7597569d74 from 0 to 1

kuadrant-system

replicaset-controller

authorino-65db9f99d7

SuccessfulDelete

Deleted pod: authorino-65db9f99d7-l7q4s

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-74db894f99 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-65db9f99d7 from 1 to 0

kuadrant-system

replicaset-controller

authorino-7597569d74

SuccessfulDelete

Deleted pod: authorino-7597569d74-g74pm

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-65db9f99d7 from 0 to 1

kuadrant-system

replicaset-controller

authorino-74db894f99

SuccessfulDelete

Deleted pod: authorino-74db894f99-ks6w4

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-74db894f99 from 1 to 0

kuadrant-system

replicaset-controller

authorino-8fd5b54

SuccessfulCreate

Created pod: authorino-8fd5b54-cwv87

kuadrant-system

multus

authorino-74db894f99-ks6w4

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-74db894f99-ks6w4

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

authorino-8fd5b54-cwv87

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

kubelet

authorino-8fd5b54-cwv87

Started

Container started

kuadrant-system

kubelet

authorino-74db894f99-ks6w4

Started

Container started

kuadrant-system

multus

authorino-8fd5b54-cwv87

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-74db894f99-ks6w4

Created

Container created

kuadrant-system

kubelet

authorino-8fd5b54-cwv87

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 563ms (563ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-8fd5b54-cwv87

Created

Container created

kuadrant-system

kubelet

authorino-74db894f99-ks6w4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 805ms (805ms including waiting). Image size: 208640811 bytes.

kuadrant-system

kubelet

authorino-dc8775675-8b2gn

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-dc8775675

SuccessfulDelete

Deleted pod: authorino-dc8775675-8b2gn

kuadrant-system

kubelet

authorino-74db894f99-ks6w4

Killing

Stopping container authorino

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-z228w

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-6466c554d8-z228w

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-z228w

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-z228w

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-z228w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 262ms (262ms including waiting). Image size: 235100981 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-z228w

Started

Container started

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-xvtl9

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xvtl9

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-p8qh9

opendatahub

multus

ai-gateway-controller-7d85675f98-p8qh9

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p8qh9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.422s (1.422s including waiting). Image size: 183888297 bytes.

opendatahub

llmisvc-controller-manager-6466c554d8-z228w_965b90cc-7b94-4baa-b9d4-0bea89be7317

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-z228w_965b90cc-7b94-4baa-b9d4-0bea89be7317 became leader
(x2)

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p8qh9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"
(x2)

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p8qh9

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-p8qh9_d188c6d3-ca96-49b7-ac48-8a9267b5b809

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-p8qh9_d188c6d3-ca96-49b7-ac48-8a9267b5b809 became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p8qh9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 387ms (387ms including waiting). Image size: 183888297 bytes.
(x2)

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p8qh9

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-pdt6z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-hv6zx
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-pdt6z

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5f78687d5b-hv6zx

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-hv6zx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-pdt6z

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-hv6zx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-pdt6z

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-hv6zx

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-hv6zx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.159s (2.159s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-pdt6z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-pdt6z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.061s (2.061s including waiting). Image size: 125317101 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-55f5889bd4 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-55f5889bd4

SuccessfulCreate

Created pod: ai-gateway-controller-55f5889bd4-fv926

opendatahub

kubelet

ai-gateway-controller-55f5889bd4-fv926

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-55f5889bd4-fv926

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 308ms (308ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-55f5889bd4-fv926

Created

Container created

opendatahub

kubelet

ai-gateway-controller-55f5889bd4-fv926

Started

Container started

opendatahub

multus

ai-gateway-controller-55f5889bd4-fv926

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes
(x2)

opendatahub

kubelet

maas-controller-5d7d58c6ff-pncqs

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:38f7584e30726e98edde0f4de4b4f7d9cb8778f465359c6ea003bd6b218f410e"

opendatahub

kubelet

maas-controller-5d7d58c6ff-pncqs

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:38f7584e30726e98edde0f4de4b4f7d9cb8778f465359c6ea003bd6b218f410e" in 500ms (500ms including waiting). Image size: 200053271 bytes.
(x2)

opendatahub

kubelet

maas-controller-5d7d58c6ff-pncqs

Started

Container started
(x2)

opendatahub

kubelet

maas-controller-5d7d58c6ff-pncqs

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p8qh9

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-p8qh9

opendatahub

maas-controller-5d7d58c6ff-pncqs_93ba8731-9186-4af1-afc1-ab01aff3bce7

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5d7d58c6ff-pncqs_93ba8731-9186-4af1-afc1-ab01aff3bce7 became leader

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.014s (1.014s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

Created

Container created

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-pdnxs

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pdnxs

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-pdnxs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pdnxs

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.021s (1.021s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pdnxs

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-pdnxs

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-z7swk

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-z7swk

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-z7swk

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-z7swk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 220ms (220ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-z7swk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-z7swk

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 182ms (182ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz

opendatahub

ai-gateway-controller-55f5889bd4-fv926_94a1f5aa-fca0-4f77-b6f8-391bfd60f926

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-55f5889bd4-fv926_94a1f5aa-fca0-4f77-b6f8-391bfd60f926 became leader

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

Created

Container created

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-8wtq4

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 209ms (209ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88rhgz

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-8wtq4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-8wtq4

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

kubelet

echo-simulator-kserve-64b6f8f96c-8wtq4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.491s (1.492s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-8wtq4

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-8wtq4

Started

Container started

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 171ms (171ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 195ms (195ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-nllbj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-8d5wt

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7d9897b54c from 1 to 4

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-xhs8n

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-nllbj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-nllbj

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

kuadrant-system

multus

authorino-65c6d4fc99-x6wdt

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-65c6d4fc99-x6wdt

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16"

kuadrant-system

replicaset-controller

authorino-65c6d4fc99

SuccessfulCreate

Created pod: authorino-65c6d4fc99-x6wdt

kuadrant-system

kubelet

authorino-65c6d4fc99-x6wdt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-nllbj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.498s (2.498s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-nllbj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-nllbj

Created

Container created

kuadrant-system

kubelet

authorino-65c6d4fc99-x6wdt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

Started

Container started

kuadrant-system

kubelet

authorino-65c6d4fc99-x6wdt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fb72464b7c88f036afad7667ccdbe7a465919a5722f492e7da3598399ac13c16" in 844ms (844ms including waiting). Image size: 208640811 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.591s (2.591s including waiting). Image size: 183555333 bytes.
(x4)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-8fd5b54 from 1 to 0

kuadrant-system

kubelet

authorino-8fd5b54-cwv87

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-8fd5b54

SuccessfulDelete

Deleted pod: authorino-8fd5b54-cwv87
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-nllbj

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-nllbj

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.709s (12.709s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-f74x8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-rmq6s

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-9twbb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-v7qbw

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7d9897b54c from 4 to 8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-9twbb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-f74x8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-f74x8

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-f74x8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-f74x8

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-9twbb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-9twbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-9twbb

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-f74x8

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-f74x8

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-9twbb

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-9twbb

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7d9897b54c-5fwdk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-7d9897b54c-j2w5h

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7d9897b54c from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ait-4da58cb4-openshift-default-64bc999667

SuccessfulCreate

Created pod: e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

openshift-ingress

replicaset-controller

e2e-ait-c1b2ed0a-openshift-default-76d4b649c

SuccessfulCreate

Created pod: e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

openshift-ingress

deployment-controller

e2e-ait-4da58cb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4da58cb4-openshift-default-64bc999667 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-4da58cb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4da58cb4

openshift-ingress

gateway_labeler_controller

e2e-ait-c1b2ed0a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c1b2ed0a

openshift-ingress

deployment-controller

e2e-ait-c1b2ed0a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c1b2ed0a-openshift-default-76d4b649c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-cdd5b3ae-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-cdd5b3ae-gw

openshift-ingress

multus

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-cdd5b3ae-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557

SuccessfulCreate

Created pod: e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

openshift-ingress

gateway_labeler_controller

e2e-ait-5431fa34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5431fa34

openshift-ingress

replicaset-controller

e2e-ait-5431fa34-openshift-default-6685769f9

SuccessfulCreate

Created pod: e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

openshift-ingress

deployment-controller

e2e-ait-5431fa34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5431fa34-openshift-default-6685769f9 from 0 to 1

openshift-ingress

multus

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-cdd5b3ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-cdd5b3ae-5c9679df78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-cdd5b3ae: serviceaccount "payload-processing-e2e-migrate-cdd5b3ae" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4

openshift-ingress

kubelet

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-cdd5b3ae: serviceaccount "payload-processing-e2e-migrate-cdd5b3ae" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-cdd5b3ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4da58cb4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4da58cb4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4da58cb4-5bf47cf84 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4da58cb4-5bf47cf84

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4da58cb4-5bf47cf84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4da58cb4: serviceaccount "payload-processing-e2e-ait-4da58cb4" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4da58cb4: serviceaccount "payload-processing-e2e-ait-4da58cb4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c1b2ed0a: serviceaccount "payload-processing-e2e-ait-c1b2ed0a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4da58cb4-5bf47cf84

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c1b2ed0a: serviceaccount "payload-processing-e2e-ait-c1b2ed0a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c1b2ed0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c1b2ed0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c1b2ed0a-c9fd566bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5431fa34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5431fa34-78fdf5698d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5431fa34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5431fa34-75999fc7c9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

openshift-ingress

kubelet

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5431fa34: serviceaccount "payload-processing-e2e-ait-5431fa34" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5431fa34-78fdf5698d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5431fa34-78fdf5698d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5431fa34-78fdf5698d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5431fa34: serviceaccount "payload-processing-e2e-ait-5431fa34" not found

openshift-ingress

deployment-controller

e2e-derive-48623dd7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-48623dd7-openshift-default-5c8b5957fc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

e2e-derive-48623dd7-openshift-default-5c8b5957fc

SuccessfulCreate

Created pod: e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

openshift-ingress

multus

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-48623dd7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-48623dd7

openshift-ingress

multus

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.739s (3.739s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.104s (4.104s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.465s (2.465s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.455s (2.455s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.146s (4.146s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-derive-48623dd7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-48623dd7-58d567b984 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-48623dd7-58d567b984

SuccessfulCreate

Created pod: payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-48623dd7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-48623dd7: serviceaccount "payload-processing-e2e-derive-48623dd7" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-48623dd7-58d567b984

FailedCreate

Error creating: pods "payload-processing-e2e-derive-48623dd7-58d567b984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-48623dd7: serviceaccount "payload-processing-e2e-derive-48623dd7" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-5431fa34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-5431fa34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Unhealthy

Readiness probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

ProbeError

Readiness probe error: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-cdd5b3ae-5c9679df78-hn25d

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4da58cb4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4da58cb4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c1b2ed0a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-cdd5b3ae-db46c6579-6slh4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-c1b2ed0a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-cdd5b3ae-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-cdd5b3ae-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4da58cb4-6568cfb4ff-ljv2q

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-4da58cb4-5bf47cf84-d8gbq

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5431fa34-75999fc7c9-s5dbf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5431fa34-78fdf5698d-tg8rn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-105228

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-105228

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-48623dd7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-48623dd7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w2-105228-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-105228-openshift-default-7cfc8cdfb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-c81f42

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-c81f42

openshift-ingress

deployment-controller

e2e-worker-w3-c81f42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c81f42-openshift-default-c7f9d447 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c1b2ed0a-65b5f84df5-8879s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c1b2ed0a-c9fd566bb-9hvvg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-4da58cb4-openshift-default-64bc999667-tbvq4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-c1b2ed0a-openshift-default-76d4b649c-pbtcv

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-cdd5b3ae-gw-openshift-default-84fc8fc557-4dk7g

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

openshift-ingress

deployment-controller

e2e-worker-w4-53dcb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-53dcb1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-53dcb1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-105228

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-105228-554d9ddf7d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-105228-554d9ddf7d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-105228-554d9ddf7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-105228: serviceaccount "payload-processing-e2e-worker-w2-105228" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-105228: serviceaccount "payload-processing-e2e-worker-w2-105228" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-105228

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-105228-554d9ddf7d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-5431fa34-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-5431fa34-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-derive-48623dd7-58d567b984-j9qxm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-48623dd7-6f4c5fc555-7zs5s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-53dcb1: serviceaccount "payload-processing-e2e-worker-w4-53dcb1" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-53dcb1: serviceaccount "payload-processing-e2e-worker-w4-53dcb1" not found

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-4cd3fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-4cd3fb

openshift-ingress

deployment-controller

e2e-worker-w0-4cd3fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

openshift-ingress

kubelet

e2e-derive-48623dd7-openshift-default-5c8b5957fc-w55zd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-53dcb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-53dcb1-7c7b578b74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-53dcb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-7a590a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-7a590a

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-5431fa34-openshift-default-6685769f9-p95b7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-worker-w1-7a590a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a590a-openshift-default-7d55f4c4df from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-c81f42: serviceaccount "payload-processing-e2e-worker-w3-c81f42" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-c81f42

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-c81f42-7b97585bf6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-c81f42

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-c81f42-7b97585bf6

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-c81f42-7b97585bf6

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-c81f42-7b97585bf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-c81f42: serviceaccount "payload-processing-e2e-worker-w3-c81f42" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

openshift-ingress

multus

payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-7a590a-67fbb59666

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-7a590a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-7a590a: serviceaccount "payload-processing-e2e-worker-w1-7a590a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-7a590a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-7a590a-67fbb59666 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-7a590a-67fbb59666

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-7a590a-67fbb59666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-7a590a: serviceaccount "payload-processing-e2e-worker-w1-7a590a" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4cd3fb-85db575d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-4cd3fb-85db575d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4cd3fb: serviceaccount "payload-processing-e2e-worker-w0-4cd3fb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-4cd3fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-4cd3fb-85db575d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4cd3fb: serviceaccount "payload-processing-e2e-worker-w0-4cd3fb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4cd3fb-85db575d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-4cd3fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-kvdnb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.453s (2.453s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kvdnb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-105228-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-105228-openshift-default-7cfc8cdfb5 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-4cd3fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5 from 1 to 3

openshift-ingress

deployment-controller

e2e-worker-w3-c81f42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c81f42-openshift-default-c7f9d447 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-53dcb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-7a590a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a590a-openshift-default-7d55f4c4df from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w3-c81f42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c81f42-openshift-default-c7f9d447 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-105228-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-105228-openshift-default-7cfc8cdfb5 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Created

Container created

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

openshift-ingress

deployment-controller

e2e-worker-w4-53dcb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Started

Container started

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-4cd3fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5 from 3 to 4

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-105228-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-105228-openshift-default-7cfc8cdfb5 from 3 to 6

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

Started

Container started

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-53dcb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49 from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554
(x5)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-4cd3fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

Started

Container started

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-c81f42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c81f42-openshift-default-c7f9d447 from 3 to 6

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

Started

Container started

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

Started

Container started

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-105228-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-105228-openshift-default-7cfc8cdfb5 from 6 to 7

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

Created

Container created

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

openshift-ingress

deployment-controller

e2e-worker-w1-7a590a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a590a-openshift-default-7d55f4c4df from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

SuccessfulRescale

New size: 7; reason:

openshift-ingress

deployment-controller

e2e-worker-w3-c81f42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c81f42-openshift-default-c7f9d447 from 6 to 7

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

openshift-ingress

replicaset-controller

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

openshift-ingress

deployment-controller

e2e-worker-w0-4cd3fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-4cd3fb-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

openshift-ingress

replicaset-controller

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5

SuccessfulCreate

Created pod: e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

openshift-ingress

deployment-controller

e2e-worker-w2-105228-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-105228-openshift-default-7cfc8cdfb5 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-105228-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Started

Container started

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Created

Container created

openshift-ingress

multus

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

openshift-ingress

deployment-controller

e2e-worker-w4-53dcb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49 from 5 to 10

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53dcb1-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

openshift-ingress

replicaset-controller

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Created

Container created

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-7a590a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a590a-openshift-default-7d55f4c4df from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

openshift-ingress

replicaset-controller

e2e-worker-w3-c81f42-openshift-default-c7f9d447

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-c81f42-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-c81f42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-c81f42-openshift-default-c7f9d447 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w1-7a590a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a590a-openshift-default-7d55f4c4df from 8 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

Started

Container started

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-7a590a-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-7a590a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-7a590a-openshift-default-7d55f4c4df from 9 to 10

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

openshift-ingress

multus

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Unhealthy

Liveness probe failed: Get "https://10.133.0.37:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-snzms

Unhealthy

Liveness probe failed: Get "http://10.134.0.20:6080/livez": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-mt-7a04e002-openshift-default-6669855c89

SuccessfulCreate

Created pod: e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

openshift-ingress

deployment-controller

e2e-mt-7a04e002-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7a04e002-openshift-default-6669855c89 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-7a04e002

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7a04e002

openshift-ingress

multus

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7a04e002

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7a04e002-849d65ff6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7a04e002

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7a04e002-846dbb5b54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7a04e002: serviceaccount "payload-processing-e2e-mt-7a04e002" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7a04e002-846dbb5b54

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7a04e002-846dbb5b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7a04e002: serviceaccount "payload-processing-e2e-mt-7a04e002" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7a04e002-846dbb5b54

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-0a531c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-0a531c

openshift-ingress

deployment-controller

e2e-api-a-0a531c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0a531c-openshift-default-585b78df5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-0a531c-openshift-default-585b78df5

SuccessfulCreate

Created pod: e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

openshift-ingress

multus

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0a531c-dc7fd5988

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0a531c-dc7fd5988

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-0a531c-dc7fd5988-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0a531c: serviceaccount "payload-processing-e2e-api-a-0a531c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-0a531c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-0a531c-dc7fd5988 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-0a531c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0a531c: serviceaccount "payload-processing-e2e-api-a-0a531c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7a04e002-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7a04e002-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-b-f9e9fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f9e9fd

openshift-ingress

replicaset-controller

e2e-api-b-f9e9fd-openshift-default-6cccc5769c

SuccessfulCreate

Created pod: e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

openshift-ingress

deployment-controller

e2e-api-b-f9e9fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f9e9fd-openshift-default-6cccc5769c from 0 to 1

openshift-ingress

multus

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f9e9fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f9e9fd-65498cb89d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f9e9fd-65498cb89d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f9e9fd-65498cb89d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f9e9fd: serviceaccount "payload-processing-e2e-api-b-f9e9fd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f9e9fd: serviceaccount "payload-processing-e2e-api-b-f9e9fd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f9e9fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f9e9fd-65498cb89d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq

Started

Container started

openshift-ingress

deployment-controller

e2e-api-a-6bda55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-6bda55-openshift-default-757659f87 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-6bda55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6bda55

openshift-ingress

replicaset-controller

e2e-api-a-6bda55-openshift-default-757659f87

SuccessfulCreate

Created pod: e2e-api-a-6bda55-openshift-default-757659f87-x82c7
(x18)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": context deadline exceeded

openshift-ingress

multus

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6bda55-5d47b6f544

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-6bda55-5d47b6f544-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6bda55: serviceaccount "payload-processing-e2e-api-a-6bda55" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6bda55-5d47b6f544

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6bda55: serviceaccount "payload-processing-e2e-api-a-6bda55" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-6bda55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-6bda55-6d56d87b79 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-6bda55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-6bda55-5d47b6f544 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx

Created

Container created

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Unhealthy

Readiness probe failed: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

ProbeError

Readiness probe error: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Unhealthy

Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

ProbeError

Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-8d5wt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-nllbj

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-j2w5h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-j2w5h

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-nllbj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-8d5wt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7d9897b54c from 10 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6bda55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6bda55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a531c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a531c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-rmq6s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7d9897b54c from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-rmq6s

openshift-ingress

kubelet

payload-processing-e2e-api-a-0a531c-dc7fd5988-k4svr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0a531c-78d5c4c9c9-58xs9

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-6a4499

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6a4499

openshift-ingress

deployment-controller

e2e-api-b-6a4499-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6a4499-openshift-default-8677876f85 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-6a4499-openshift-default-8677876f85

SuccessfulCreate

Created pod: e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

openshift-ingress

multus

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a531c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0a531c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6a4499

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6a4499-547794fbb6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6a4499

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6a4499-565465d8dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6a4499-565465d8dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6a4499-565465d8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6a4499: serviceaccount "payload-processing-e2e-api-b-6a4499" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6a4499-547794fbb6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6a4499-547794fbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6a4499: serviceaccount "payload-processing-e2e-api-b-6a4499" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6a4499-565465d8dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6a4499-547794fbb6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-ef1186-openshift-default-6dc695db95

SuccessfulCreate

Created pod: e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

openshift-ingress

deployment-controller

e2e-api-a-ef1186-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ef1186-openshift-default-6dc695db95 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-ef1186

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ef1186

openshift-ingress

multus

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7a04e002-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-7a04e002-openshift-default-6669855c89

SuccessfulCreate

Created pod: e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

openshift-ingress

replicaset-controller

e2e-mt-7a04e002-openshift-default-6669855c89

SuccessfulCreate

Created pod: e2e-mt-7a04e002-openshift-default-6669855c89-988sj

openshift-ingress

deployment-controller

e2e-mt-7a04e002-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7a04e002-openshift-default-6669855c89 from 1 to 3

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

Started

Container started

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

Started

Container started

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

Created

Container created

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ef1186-7f6d9c4844

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ef1186-7f6d9c4844

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ef1186-7f6d9c4844-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ef1186: serviceaccount "payload-processing-e2e-api-a-ef1186" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ef1186

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ef1186-7f6d9c4844 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ef1186

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ef1186-85dd565675 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ef1186-85dd565675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ef1186-85dd565675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ef1186-85dd565675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ef1186: serviceaccount "payload-processing-e2e-api-a-ef1186" not found

openshift-ingress

multus

payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-6jqvg

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x5)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

ProbeError

Readiness probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-0a531c-openshift-default-585b78df5-lwjzk

Unhealthy

Readiness probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.577s (2.577s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7a04e002-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7a04e002-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f9e9fd-65498cb89d-tgdpq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f9e9fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f9e9fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f9e9fd-59d57bf575-4ndlf

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.116:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-api-a-6bda55-5d47b6f544-wn6rn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6bda55-6d56d87b79-zgwdx

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f9e9fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f9e9fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-b-70621c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-70621c

openshift-ingress

deployment-controller

e2e-api-b-70621c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-70621c-openshift-default-74bc85477 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

Unhealthy

Startup probe failed: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

ProbeError

Startup probe error: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-70621c-openshift-default-74bc85477

SuccessfulCreate

Created pod: e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

openshift-ingress

multus

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6bda55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6bda55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-70621c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-70621c-84fb96ff87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-70621c-84fb96ff87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-70621c-84fb96ff87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-70621c-84fb96ff87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-70621c: serviceaccount "payload-processing-e2e-api-b-70621c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-70621c-76fdbc8458

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-70621c-76fdbc8458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-70621c: serviceaccount "payload-processing-e2e-api-b-70621c" not found

openshift-ingress

multus

payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-70621c-76fdbc8458

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt

openshift-ingress

multus

payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-70621c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-70621c-76fdbc8458 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-f9e9fd-openshift-default-6cccc5769c-wwz9d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-2bfb1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2bfb1b-openshift-default-79d9495f97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-2bfb1b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-2bfb1b

openshift-ingress

replicaset-controller

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97

SuccessfulCreate

Created pod: e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

openshift-ingress

multus

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-6bda55-openshift-default-757659f87-x82c7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2bfb1b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2bfb1b: serviceaccount "payload-processing-e2e-ipp-a-2bfb1b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2bfb1b: serviceaccount "payload-processing-e2e-ipp-a-2bfb1b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2bfb1b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2bfb1b-5578c9df66 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229

Started

Container started

opendatahub

multus

test-curl-7145-86b048

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7145-86b048

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-6a4499-openshift-default-8677876f85

SuccessfulCreate

Created pod: e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6a4499-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-b-6a4499-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6a4499-openshift-default-8677876f85 from 1 to 2

openshift-ingress

multus

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

Started

Container started

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

Created

Container created

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7145-86b048

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.401s (2.401s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7145-86b048

Created

Container created

opendatahub

kubelet

test-curl-7145-86b048

Started

Container started

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

ProbeError

Readiness probe error: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Unhealthy

Readiness probe failed: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

opendatahub

kubelet

test-curl-7145-86b048

Killing

Stopping container test-curl-7145-86b048
(x5)

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

ProbeError

Readiness probe error: Get "http://10.134.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Unhealthy

Readiness probe failed: Get "http://10.134.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6a4499-565465d8dc-jzw59

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6a4499-547794fbb6-ttvxk

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ef1186-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ef1186-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

Killing

Stopping container payload-processing

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-gjccx

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-gjccx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6a4499-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6a4499-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gjccx

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gjccx

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gjccx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gjccx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gjccx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6a4499-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6a4499-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ef1186-85dd565675-phv7g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ef1186-7f6d9c4844-qvjlq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-nhql8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-57fc8f9f4c-vgbrn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-5578c9df66-kp229

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-xhfhq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-v4qm6

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ef1186-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-6a4499-openshift-default-8677876f85-2m44b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ef1186-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2bfb1b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2bfb1b: serviceaccount "payload-processing-e2e-ipp-a-2bfb1b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2bfb1b: serviceaccount "payload-processing-e2e-ipp-a-2bfb1b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2bfb1b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7a04e002

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7a04e002-849d65ff6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7a04e002

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7a04e002-846dbb5b54 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7a04e002-846dbb5b54

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7a04e002-846dbb5b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7a04e002: serviceaccount "payload-processing-e2e-mt-7a04e002" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7a04e002-846dbb5b54

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7a04e002: serviceaccount "payload-processing-e2e-mt-7a04e002" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.121s (2.121s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.414s (2.414s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-dea6ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-dea6ee

openshift-ingress

deployment-controller

e2e-ipp-a-dea6ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dea6ee-openshift-default-85794dd75 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-dea6ee-openshift-default-85794dd75

SuccessfulCreate

Created pod: e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

openshift-ingress

multus

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dea6ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dea6ee: serviceaccount "payload-processing-e2e-ipp-a-dea6ee" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dea6ee: serviceaccount "payload-processing-e2e-ipp-a-dea6ee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dea6ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f

SuccessfulCreate

Created pod: e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

openshift-ingress

deployment-controller

e2e-ipp-b-f0a01c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f0a01c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f0a01c

openshift-ingress

multus

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-ef1186-openshift-default-6dc695db95-4dk7g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f0a01c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f0a01c: serviceaccount "payload-processing-e2e-ipp-b-f0a01c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f0a01c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f0a01c-74b677884d from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f0a01c-74b677884d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f0a01c-74b677884d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f0a01c: serviceaccount "payload-processing-e2e-ipp-b-f0a01c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f0a01c-74b677884d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

Unhealthy

Readiness probe failed: Get "https://10.134.0.31:8000/ready": context deadline exceeded

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f1222e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f1222e

openshift-ingress

deployment-controller

e2e-ipp-a-f1222e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f1222e-openshift-default-864954bd4c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-f1222e-openshift-default-864954bd4c

SuccessfulCreate

Created pod: e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

openshift-ingress

multus

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7145-f91f9a

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7145-f91f9a

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7145-f91f9a

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 885ms (885ms including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7145-f91f9a

Started

Container started

opendatahub

kubelet

test-curl-7145-f91f9a

Created

Container created

openshift-ingress

multus

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97

SuccessfulCreate

Created pod: e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

opendatahub

kubelet

test-curl-7145-f91f9a

Killing

Stopping container test-curl-7145-f91f9a

openshift-ingress

deployment-controller

e2e-ipp-a-2bfb1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2bfb1b-openshift-default-79d9495f97 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2bfb1b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97

SuccessfulCreate

Created pod: e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

openshift-ingress

replicaset-controller

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97

SuccessfulCreate

Created pod: e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f1222e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f1222e-7f85759464 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f1222e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1222e-7f85759464

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1222e: serviceaccount "payload-processing-e2e-ipp-a-f1222e" not found

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1222e-7f85759464

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f1222e-7f85759464-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1222e: serviceaccount "payload-processing-e2e-ipp-a-f1222e" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-70621c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-70621c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-70621c-84fb96ff87-xwxm5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-70621c-76fdbc8458-mjfqt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

Unhealthy

Startup probe failed: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

ProbeError

Startup probe error: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-7a04e002-846dbb5b54-td7vk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7a04e002-849d65ff6c-x6x5w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2bfb1b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2bfb1b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-5bffbfd99b-w2rg9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-6fb4b499c9-6c8ft

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2bfb1b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2bfb1b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-c85b58bf5-vjkw9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-74b677884d-spp88

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-70621c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-70621c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dea6ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dea6ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dea6ee: serviceaccount "payload-processing-e2e-ipp-a-dea6ee" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dea6ee: serviceaccount "payload-processing-e2e-ipp-a-dea6ee" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2

Created

Container created

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-026c2f-openshift-default-86445dfbc7

SuccessfulCreate

Created pod: e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

openshift-ingress

deployment-controller

e2e-ipp-a-026c2f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-026c2f-openshift-default-86445dfbc7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-026c2f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-026c2f

openshift-ingress

multus

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-70621c-openshift-default-74bc85477-kvzf4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-5fd75db559-qhvk8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-7f85759464-x48hg

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-026c2f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-026c2f-8fbb864b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-026c2f-8fbb864b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-026c2f: serviceaccount "payload-processing-e2e-ipp-a-026c2f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-026c2f-8fbb864b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-026c2f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-026c2f-8fbb864b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-026c2f: serviceaccount "payload-processing-e2e-ipp-a-026c2f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f0a01c: serviceaccount "payload-processing-e2e-ipp-b-f0a01c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f0a01c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f0a01c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f0a01c-548b56cf9d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f0a01c: serviceaccount "payload-processing-e2e-ipp-b-f0a01c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-096cc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-096cc3

openshift-ingress

replicaset-controller

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5

SuccessfulCreate

Created pod: e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

openshift-ingress

deployment-controller

e2e-ipp-b-096cc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-096cc3-openshift-default-5c98c69cb5 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-096cc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096cc3: serviceaccount "payload-processing-e2e-ipp-b-096cc3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096cc3: serviceaccount "payload-processing-e2e-ipp-b-096cc3" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-096cc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-096cc3-6b7597fb4b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1222e: serviceaccount "payload-processing-e2e-ipp-a-f1222e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f1222e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f1222e-cc5b9d946 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f1222e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1222e-cc5b9d946

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f1222e-cc5b9d946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f1222e: serviceaccount "payload-processing-e2e-ipp-a-f1222e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f1222e-cc5b9d946

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096cc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096cc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-026c2f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-026c2f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-e74c27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-e74c27

openshift-ingress

replicaset-controller

e2e-ipp-b-e74c27-openshift-default-7b8d554b69

SuccessfulCreate

Created pod: e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7d9897b54c from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-wtc5x

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-wtc5x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-b-e74c27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-e74c27-openshift-default-7b8d554b69 from 0 to 1

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-988sj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-92fw5

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-7a04e002-openshift-default-6669855c89-9khb6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096cc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096cc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Unhealthy

Readiness probe failed: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

ProbeError

Readiness probe error: Get "http://10.134.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e74c27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e74c27-b5854795d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e74c27-b5854795d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e74c27-b5854795d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e74c27: serviceaccount "payload-processing-e2e-ipp-b-e74c27" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e74c27: serviceaccount "payload-processing-e2e-ipp-b-e74c27" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e74c27-b5854795d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e74c27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2bfb1b-776b47c7b7-nqqcx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2bfb1b-79ddc47b6d-m5wvr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f0a01c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f0a01c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1222e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-8fbb864b6-xrvjn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1222e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c8ff686cf-r47m7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dea6ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dea6ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-fb57m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-hrbqm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-kcbjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-2bfb1b-openshift-default-79d9495f97-xcsxr

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-6b7597fb4b-sjwqz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f0a01c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f0a01c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-56c74bd459-jtrmk

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-026c2f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-026c2f-5f47c6c65b from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-026c2f: serviceaccount "payload-processing-e2e-ipp-a-026c2f" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-026c2f: serviceaccount "payload-processing-e2e-ipp-a-026c2f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-026c2f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e74c27-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e74c27-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f0a01c-64db95489f-htnff

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f0a01c-548b56cf9d-czh7p

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1222e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f1222e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dea6ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dea6ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096cc3-68885f5d96

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-096cc3-68885f5d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096cc3: serviceaccount "payload-processing-e2e-ipp-b-096cc3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-096cc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-f0a01c-openshift-default-7f5fd56c7f-86dh8

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096cc3: serviceaccount "payload-processing-e2e-ipp-b-096cc3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-096cc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-096cc3-68885f5d96 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

openshift-ingress

multus

payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096cc3-68885f5d96

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

openshift-ingress

replicaset-controller

e2e-praxis-a-87f1b5-openshift-default-649cd9d869

SuccessfulCreate

Created pod: e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

openshift-ingress

deployment-controller

e2e-praxis-a-87f1b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-87f1b5-openshift-default-649cd9d869 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-87f1b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-87f1b5

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

Started

Container started

openshift-ingress

multus

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc

SuccessfulCreate

Created pod: e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

openshift-ingress

deployment-controller

e2e-ipp-b-a81a48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a81a48-openshift-default-5fdddf48dc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a81a48

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a81a48

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-87f1b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-87f1b5-79ccf88478 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-87f1b5: serviceaccount "payload-processing-e2e-praxis-a-87f1b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-87f1b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-87f1b5-79ccf88478

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-5c8ff8b67f-bwvkv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-b5854795d-kdgjn

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-87f1b5-79ccf88478

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-87f1b5-79ccf88478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-87f1b5: serviceaccount "payload-processing-e2e-praxis-a-87f1b5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a81a48: serviceaccount "payload-processing-e2e-ipp-b-a81a48" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a81a48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a81a48-67cb59c596 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a81a48-67cb59c596

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a81a48-67cb59c596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a81a48: serviceaccount "payload-processing-e2e-ipp-b-a81a48" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a81a48-67cb59c596

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a81a48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e74c27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e74c27-6776bdb4fb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e74c27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e74c27: serviceaccount "payload-processing-e2e-ipp-b-e74c27" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e74c27: serviceaccount "payload-processing-e2e-ipp-b-e74c27" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.18s (1.18s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

Created

Container created

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-a-f1222e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-a-f1222e: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-a-f1222e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-a-f1222e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ccf9b92a-0fd1-465f-aa33-028324b3dbb2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

Unhealthy

Readiness probe failed: dial tcp 10.134.0.156:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f1222e-cc5b9d946-tf5pj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

Unhealthy

Readiness probe failed: dial tcp 10.134.0.155:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f1222e-577f7f77dc-n9wtw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-f1222e-openshift-default-864954bd4c-6wlcb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dea6ee-6cffdbb5bb-jmmb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dea6ee-68c5744779-vth9b

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-dea6ee-openshift-default-85794dd75-skxkx

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-praxis-b-2382a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-2382a9-openshift-default-65f4d6457 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-2382a9-openshift-default-65f4d6457

SuccessfulCreate

Created pod: e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-2382a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-2382a9

openshift-ingress

multus

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

ProbeError

Readiness probe error: Get "http://10.134.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

Unhealthy

Readiness probe failed: Get "http://10.134.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-5c77644c9-7w5s5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-67cb59c596-ts5cs

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2382a9: serviceaccount "payload-processing-e2e-praxis-b-2382a9" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2382a9-8594fcccfb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-2382a9-8594fcccfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2382a9: serviceaccount "payload-processing-e2e-praxis-b-2382a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-2382a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-2382a9-8594fcccfb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2382a9-8594fcccfb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-2382a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

Unhealthy

Readiness probe failed: Get "http://10.133.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

ProbeError

Readiness probe error: Get "http://10.133.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-ipp-b-096cc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-096cc3-openshift-default-5c98c69cb5 from 1 to 3

openshift-ingress

replicaset-controller

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5

SuccessfulCreate

Created pod: e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5

SuccessfulCreate

Created pod: e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096cc3-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

Unhealthy

Readiness probe failed: dial tcp 10.134.0.169:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096cc3-68885f5d96-p2smp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e74c27-79f49467d7-ttpbm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e74c27-6776bdb4fb-bwxs6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096cc3-7d5bfb9cc9-gb5n2

Unhealthy

Readiness probe failed: dial tcp 10.134.0.168:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

Unhealthy

Readiness probe failed: Get "http://10.133.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

ProbeError

Readiness probe error: Get "http://10.133.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

ProbeError

Readiness probe error: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

Unhealthy

Readiness probe failed: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

Unhealthy

Readiness probe failed: Get "http://10.133.0.111:15021/healthz/ready": read tcp 10.133.0.2:41810->10.133.0.111:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

ProbeError

Readiness probe error: Get "http://10.133.0.111:15021/healthz/ready": read tcp 10.133.0.2:41810->10.133.0.111:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e74c27-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e74c27-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ipp-b-096cc3-openshift-default-dockercfg-5rpdm); attempting to pull the image may not succeed.
(x4)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

ProbeError

Startup probe error: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a81a48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a81a48-5bc4b674db from 0 to 1
(x4)

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

Unhealthy

Startup probe failed: Get "http://10.133.0.114:15021/healthz/ready": dial tcp 10.133.0.114:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a81a48-5bc4b674db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-zb9k8

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a81a48-5bc4b674db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a81a48-5bc4b674db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a81a48: serviceaccount "payload-processing-e2e-ipp-b-a81a48" not found

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-p6pwr

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a81a48: serviceaccount "payload-processing-e2e-ipp-b-a81a48" not found

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ba9a8c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ba9a8c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a81a48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-096cc3-openshift-default-5c98c69cb5-stlql

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf

SuccessfulCreate

Created pod: e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-ba9a8c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-e74c27-openshift-default-7b8d554b69-hcw5m

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f

Started

Container started

openshift-ingress

multus

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c

SuccessfulCreate

Created pod: e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

openshift-ingress

deployment-controller

e2e-praxis-a-4cb0fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-4cb0fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-4cb0fe
(x10)

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused

openshift-ingress

multus

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ba9a8c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ba9a8c-554db57548

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ba9a8c-554db57548-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ba9a8c: serviceaccount "payload-processing-e2e-praxis-a-ba9a8c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ba9a8c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ba9a8c-554db57548 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ba9a8c: serviceaccount "payload-processing-e2e-praxis-a-ba9a8c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ba9a8c-554db57548

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r

openshift-ingress

multus

payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87f1b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87f1b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-4cb0fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4cb0fe: serviceaccount "payload-processing-e2e-praxis-a-4cb0fe" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-4cb0fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-4cb0fe-6b4758b476 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4cb0fe: serviceaccount "payload-processing-e2e-praxis-a-4cb0fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

openshift-ingress

multus

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a81a48-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a81a48-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-026c2f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-026c2f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87f1b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-87f1b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a81a48-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a81a48-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-87f1b5-79ccf88478-njqdm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-87f1b5-7947d986c-vqk5w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Unhealthy

Readiness probe failed: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-sj8tq

Unhealthy

Readiness probe failed: Get "https://10.134.0.33:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-snzms

Unhealthy

Readiness probe failed: Get "http://10.134.0.20:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-praxis-b-1f91c1-openshift-default-688c4d5857

SuccessfulCreate

Created pod: e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

openshift-ingress

deployment-controller

e2e-praxis-b-1f91c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-1f91c1-openshift-default-688c4d5857 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-1f91c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-1f91c1

openshift-ingress

multus

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

ProbeError

Readiness probe error: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

Unhealthy

Readiness probe failed: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-8f3cb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-8f3cb8
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9

SuccessfulCreate

Created pod: e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-b-8f3cb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-1f91c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-1f91c1-6c56bffc56 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1f91c1: serviceaccount "payload-processing-e2e-praxis-b-1f91c1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1f91c1: serviceaccount "payload-processing-e2e-praxis-b-1f91c1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-1f91c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-8f3cb8: serviceaccount "payload-processing-e2e-praxis-b-8f3cb8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-8f3cb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c
(x7)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-8f3cb8: serviceaccount "payload-processing-e2e-praxis-b-8f3cb8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-8f3cb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-8f3cb8-5b659b4974 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-f73c9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f73c9f-openshift-default-8476dd64cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f73c9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f73c9f

openshift-ingress

replicaset-controller

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc

SuccessfulCreate

Created pod: e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

openshift-ingress

kubelet

e2e-praxis-a-87f1b5-openshift-default-649cd9d869-bgt92

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4cb0fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4cb0fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f73c9f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f73c9f: serviceaccount "payload-processing-e2e-praxis-a-f73c9f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f73c9f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f73c9f-79dcb4b588 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f73c9f: serviceaccount "payload-processing-e2e-praxis-a-f73c9f" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2382a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2382a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ba9a8c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ba9a8c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2382a9-8594fcccfb-74rlx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2382a9-6578bcfcf5-rd7zd

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4cb0fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4cb0fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2382a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2382a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-2382a9-openshift-default-65f4d6457-fr92v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x61)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

ProbeError

Readiness probe error: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Unhealthy

Readiness probe failed: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

ProbeError

Readiness probe error: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-praxis-a-f73c9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f73c9f-openshift-default-8476dd64cc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f73c9f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc

SuccessfulCreate

Created pod: e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

openshift-ingress

multus

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

ProbeError

Readiness probe error: Get "http://10.134.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

Unhealthy

Readiness probe failed: Get "http://10.134.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Unhealthy

Readiness probe failed: Get "http://10.134.0.192:15021/healthz/ready": read tcp 10.134.0.2:37424->10.134.0.192:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

ProbeError

Readiness probe error: Get "http://10.134.0.192:15021/healthz/ready": read tcp 10.134.0.2:37424->10.134.0.192:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-666577

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-666577
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-666577-openshift-default-f887989df

SuccessfulCreate

Created pod: e2e-praxis-b-666577-openshift-default-f887989df-gvxxs
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-praxis-b-666577-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-666577-openshift-default-f887989df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ba9a8c-57d4f5cb47-7v5bt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ba9a8c-554db57548-lp65r

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

ProbeError

Startup probe error: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

Unhealthy

Startup probe failed: Get "http://10.134.0.189:15021/healthz/ready": dial tcp 10.134.0.189:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-666577-764dc95b64

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-666577-764dc95b64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-666577: serviceaccount "payload-processing-e2e-praxis-b-666577" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-666577-764dc95b64

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-666577

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-666577-764dc95b64 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-666577: serviceaccount "payload-processing-e2e-praxis-b-666577" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-666577

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-666577-f6d486d8c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f73c9f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f73c9f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-v7qbw

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-v7qbw

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7d9897b54c from 5 to 4
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-105228-6f4847cbbc-9zjnk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1f91c1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-105228-554d9ddf7d-zfvmf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1f91c1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f73c9f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f73c9f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-ba9a8c-openshift-default-54b94d8bbf-m87tw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-gjccx

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gjccx

Killing

Stopping container discovery

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1f91c1-6c56bffc56-b9lw4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1f91c1-6bdd6f76c9-sbvgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-m9drz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-b7spg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-r4tss

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-qzqlj

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-hl4xr

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-kcd5w

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rk86z

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-z9qv9

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-vhr7q

Unhealthy

Readiness probe failed: Get "https://10.134.0.31:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-rqh26

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-105228-openshift-default-7cfc8cdfb5-t6qs9

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-z7swk

Unhealthy

Readiness probe failed: Get "https://10.133.0.35:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-gwwxj

Unhealthy

Readiness probe failed: Get "https://10.133.0.34:8000/ready": context deadline exceeded
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-1f91c1-openshift-default-688c4d5857-qzj74

Killing

Stopping container istio-proxy
(x9)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x2)

openshift-ingress

kubelet

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f73c9f-6d96bf5f67-2k9xq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f73c9f-79dcb4b588-jq6th

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4cb0fe-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-4cb0fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c from 1 to 2

openshift-ingress

replicaset-controller

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c

SuccessfulCreate

Created pod: e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

openshift-ingress

multus

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8f3cb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8f3cb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

Unhealthy

Startup probe failed: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

ProbeError

Startup probe error: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-666577-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

Unhealthy

Startup probe failed: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-666577-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x10)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x6)

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

ProbeError

Startup probe error: Get "http://10.134.0.199:15021/healthz/ready": dial tcp 10.134.0.199:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-7hkrv

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

ProbeError

Startup probe error: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

Unhealthy

Startup probe failed: Get "http://10.134.0.209:15021/healthz/ready": dial tcp 10.134.0.209:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-f73c9f-openshift-default-8476dd64cc-jq5v4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-666577-f6d486d8c-zpht6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-666577-764dc95b64-l8hx9

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-666577-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-666577-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-c81f42-8487bcd959-b92h9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-c81f42-7b97585bf6-29zvm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8f3cb8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-8f3cb8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-666577-openshift-default-f887989df-gvxxs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-7j5mr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-2fsz6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-5sqzt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-sxndp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-zxl2d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-dc66w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-869c8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-6z2m2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-4lg82

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-c81f42-openshift-default-c7f9d447-ldbql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4cd3fb-6f6f98c44c-wzd8b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4cd3fb-85db575d-t2nqx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-j6b2v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-699gj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-h9djl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-gt9cj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-g6dzs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-nx554

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-8wtm4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-m9fkg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-6kmk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4cd3fb-openshift-default-79cbdb49d5-5lpwt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-a-4cb0fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c from 2 to 3

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4cb0fe-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c

SuccessfulCreate

Created pod: e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

openshift-ingress

deployment-controller

e2e-ipp-a-026c2f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-026c2f-openshift-default-86445dfbc7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-026c2f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-026c2f-openshift-default-86445dfbc7

SuccessfulCreate

Created pod: e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4cb0fe-6b4758b476-f89sx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4cb0fe-57656d7975-zzlzf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-026c2f-c68c9868c-p8k56

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-026c2f-5f47c6c65b-sm9gd

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-f74x8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-f74x8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7d9897b54c from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jm56b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-jdstm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-4cb0fe-openshift-default-86c9c7d99c-fgr4r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-428zv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

Killing

Stopping container istio-proxy
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-hxswq

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-8f3cb8-8d7576f7f-wct4c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-8f3cb8-5b659b4974-wpv8j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-026c2f-openshift-default-86445dfbc7-8sfhl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a81a48-5bc4b674db-5t28f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a81a48-69c4b6847-mqhw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-8f3cb8-openshift-default-95c47cbb9-qprhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a81a48-openshift-default-5fdddf48dc-hjnlp

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-7a590a-67fbb59666-9xvnv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-7a590a-c79b8c955-f2xtv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53dcb1-7c7b578b74-n765q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53dcb1-7f5b4bcbdc-zq6r9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-cg9mk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xlmxk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-xdqm9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tvjm2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-tskq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-qbq5q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-nwmdd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-gjqww

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-9gtr9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-7a590a-openshift-default-7d55f4c4df-6j7g2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-g8qd5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-5nbfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-kbjvm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-dvzsm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-thm8x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-nn8th

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-fwk8r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-vh6vh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-2kshw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-53dcb1-openshift-default-5d7f9b4f49-lkv7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-xhs8n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-xhs8n

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-6jqvg

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6jqvg

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-kfdb7

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-kfdb7

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7d9897b54c-5fwdk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set maas-default-gateway-openshift-default-7d9897b54c from 2 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7d9897b54c

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7d9897b54c-5fwdk

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target