Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-j249g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-j249g to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

test-curl-7373-6e7f54

Scheduled

Successfully assigned opendatahub/test-curl-7373-6e7f54 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz to ip-10-0-128-19.us-west-1.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-jrmz4

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-jrmz4 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

test-curl-7376-3a9827

Scheduled

Successfully assigned opendatahub/test-curl-7376-3a9827 to ip-10-0-128-19.us-west-1.compute.internal

opendatahub

test-curl-7376-8a35a5

Scheduled

Successfully assigned opendatahub/test-curl-7376-8a35a5 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj to ip-10-0-141-104.us-west-1.compute.internal

opendatahub

test-curl-7370-c9b104

Scheduled

Successfully assigned opendatahub/test-curl-7370-c9b104 to ip-10-0-128-19.us-west-1.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-qf8tr to ip-10-0-141-104.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-578f754bb8-9qfl4 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9 to ip-10-0-128-19.us-west-1.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-jsjp8

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-jsjp8 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

test-curl-7370-a60adf

Scheduled

Successfully assigned opendatahub/test-curl-7370-a60adf to ip-10-0-128-19.us-west-1.compute.internal

opendatahub

test-curl-7370-9cf96a

Scheduled

Successfully assigned opendatahub/test-curl-7370-9cf96a to ip-10-0-128-19.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-578f754bb8-b8d6c to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

test-curl-7370-72f4fb

Scheduled

Successfully assigned opendatahub/test-curl-7370-72f4fb to ip-10-0-128-19.us-west-1.compute.internal

opendatahub

test-curl-7370-628894

Scheduled

Successfully assigned opendatahub/test-curl-7370-628894 to ip-10-0-128-19.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-578f754bb8-jpjkp to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff to ip-10-0-141-104.us-west-1.compute.internal

opendatahub

odh-model-controller-769875db56-l88st

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-l88st to ip-10-0-128-19.us-west-1.compute.internal

opendatahub

model-serving-api-75bd89fdfc-lv5fm

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-lv5fm to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-c4c65fbf-ccbt2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-ccbt2 to ip-10-0-141-104.us-west-1.compute.internal

kuadrant-system

authorino-56c6c9ddd5-frd55

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-frd55 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-hfxrj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-hfxrj to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-j4c2z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-j4c2z to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb to ip-10-0-128-19.us-west-1.compute.internal

kuadrant-system

authorino-57f7f8659f-9cb85

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-9cb85 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-fjr78

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-fjr78 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-dnh58

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-dnh58 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-c8sl7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c8sl7 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv to ip-10-0-133-226.us-west-1.compute.internal

kuadrant-system

authorino-65ff45b778-96hwh

Scheduled

Successfully assigned kuadrant-system/authorino-65ff45b778-96hwh to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-krsdr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-krsdr to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg to ip-10-0-128-19.us-west-1.compute.internal

kuadrant-system

authorino-6f6944bcdd-6rpqq

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-6rpqq to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-c7s57

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-c7s57 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-bxr9x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bxr9x to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-lzkmk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-lzkmk to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-mgw8n

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-mgw8n to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp to ip-10-0-133-226.us-west-1.compute.internal

kuadrant-system

authorino-76c6d89db4-xk9l6

Scheduled

Successfully assigned kuadrant-system/authorino-76c6d89db4-xk9l6 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-bm2hx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-bm2hx to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-4bfdv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4bfdv to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-msm7m

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-msm7m to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-02a8fa-6987989665-drfl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-02a8fa-6987989665-drfl8 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772 to ip-10-0-141-104.us-west-1.compute.internal

kuadrant-system

authorino-77dd9fff5-h8rlb

Scheduled

Successfully assigned kuadrant-system/authorino-77dd9fff5-h8rlb to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-pqpw6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-pqpw6 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-r6nlx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-r6nlx to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p to ip-10-0-141-104.us-west-1.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-llb2k

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-llb2k to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-xpm8h

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-xpm8h to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-lwspj

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-lwspj to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

maas-controller-65c8fd6c86-kxlpc

Scheduled

Successfully assigned opendatahub/maas-controller-65c8fd6c86-kxlpc to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-76f5684988-x9n4b

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-76f5684988-x9n4b to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-479363-96bb58d89-lv8jl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-479363-96bb58d89-lv8jl to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-76f5684988-h5t9m

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-76f5684988-h5t9m to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n to ip-10-0-133-226.us-west-1.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-tmw28

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-tmw28 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c9rwj to ip-10-0-141-104.us-west-1.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-x6vsn

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-x6vsn to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s to ip-10-0-128-19.us-west-1.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-t4lgz

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-t4lgz to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk to ip-10-0-141-104.us-west-1.compute.internal

opendatahub

maas-controller-655bd8bb49-gwsxw

Scheduled

Successfully assigned opendatahub/maas-controller-655bd8bb49-gwsxw to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g to ip-10-0-141-104.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-l56rn

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-l56rn to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7 to ip-10-0-133-226.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-pjgsf

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pjgsf to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

ai-gateway-controller-6467c7bcbb-q6mdg

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6467c7bcbb-q6mdg to ip-10-0-133-226.us-west-1.compute.internal

opendatahub

test-curl-7376-0d58d1

Scheduled

Successfully assigned opendatahub/test-curl-7376-0d58d1 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

Scheduled

Successfully assigned openshift-ingress/e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8 to ip-10-0-141-104.us-west-1.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-r74s8

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-r74s8 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx to ip-10-0-133-226.us-west-1.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-4xv26

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-4xv26 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns to ip-10-0-133-226.us-west-1.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-z6cfl

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-z6cfl to ip-10-0-141-104.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-wvwtp

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-wvwtp to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-2szkr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-2szkr to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9 to ip-10-0-128-19.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-w6rkh

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-w6rkh to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68 to ip-10-0-133-226.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-86d8965798-5kppx

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-86d8965798-5kppx to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv to ip-10-0-133-226.us-west-1.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-hg9wk

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-hg9wk to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc to ip-10-0-133-226.us-west-1.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-5xgvw

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-5xgvw to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4 to ip-10-0-133-226.us-west-1.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-kvcc8

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-kvcc8 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-859078-795cf98998-mghsr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-859078-795cf98998-mghsr to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg to ip-10-0-133-226.us-west-1.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-874n7

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-874n7 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-r6sd2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-r6sd2 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-q5v68

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-q5v68 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2 to ip-10-0-133-226.us-west-1.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8 to ip-10-0-133-226.us-west-1.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-bfhs7

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-bfhs7 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km to ip-10-0-128-19.us-west-1.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-tdqzj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-tdqzj to ip-10-0-133-226.us-west-1.compute.internal

cert-manager

cert-manager-597b95cb84-fsqhl

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-fsqhl to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w to ip-10-0-128-19.us-west-1.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

router-default-755f8d7949-984mn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-755f8d7949-984mn

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-755f8d7949-984mn

Scheduled

Successfully assigned openshift-ingress/router-default-755f8d7949-984mn to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm to ip-10-0-141-104.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-747d767c44-v9lrd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-747d767c44-v9lrd to ip-10-0-141-104.us-west-1.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-fhwfv

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-fhwfv to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt to ip-10-0-141-104.us-west-1.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-mx7rw

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-mx7rw to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf to ip-10-0-141-104.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-66f8fcd7fb-j5swv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-66f8fcd7fb-j5swv to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-xxpxm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-xxpxm to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b to ip-10-0-133-226.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-66f8fcd7fb-7jxn7

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-66f8fcd7fb-7jxn7 to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp to ip-10-0-128-19.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-5577b47559-4ll85

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5577b47559-4ll85 to ip-10-0-141-104.us-west-1.compute.internal

openshift-jobset-operator

jobset-controller-manager-848d766f4b-729lf

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-848d766f4b-729lf to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8 to ip-10-0-128-19.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd to ip-10-0-141-104.us-west-1.compute.internal

openshift-ingress

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4 to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr to ip-10-0-133-226.us-west-1.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-755f8d7949 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-755f8d7949

SuccessfulCreate

Created pod: router-default-755f8d7949-984mn
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-755f8d7949-984mn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-755f8d7949-984mn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-755f8d7949-984mn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-755f8d7949-984mn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-755f8d7949-984mn

Started

Container started

openshift-ingress

kubelet

router-default-755f8d7949-984mn

Created

Container created

openshift-ingress

kubelet

router-default-755f8d7949-984mn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-755f8d7949-984mn

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-755f8d7949-984mn

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 500

openshift-ingress

kubelet

router-default-755f8d7949-984mn

ProbeError

Startup probe error: HTTP probe failed with statuscode: 500 body: [-]backend-proxy-http failed: reason withheld [-]has-synced failed: reason withheld [+]process-running ok healthz check failed

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpm8h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-xpm8h

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-xpm8h

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpm8h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.848s (3.848s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpm8h

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpm8h

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpm8h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpm8h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-xxpxm

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-856cdd999f from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-856cdd999f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-xxpxm

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.228s (9.228s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.326s (9.326s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-z6kvm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-pjgsf

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pjgsf

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-pjgsf

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-tmw28

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-tmw28

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-tmw28

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pjgsf

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pjgsf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.725s (4.725s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pjgsf

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-pjgsf_d628cf9c-d7ab-410d-99b1-20597b1f9c8a

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-pjgsf_d628cf9c-d7ab-410d-99b1-20597b1f9c8a became leader

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-mx7rw

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-tmw28

Started

Container started

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

dns-operator-controller-manager-8557cbdb84-tmw28_09c6a4a1-c75c-4265-9b5d-550ecdcf373c

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-tmw28_09c6a4a1-c75c-4265-9b5d-550ecdcf373c became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-tmw28

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-tmw28

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.679s (2.679s including waiting). Image size: 190804149 bytes.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-mx7rw

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mx7rw

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-llb2k

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-llb2k

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

multus

authorino-operator-7b7bb4bc77-llb2k

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4lgz

FailedMount

MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-t4lgz

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4lgz

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-t4lgz

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mx7rw

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mx7rw

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-mx7rw

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.754s (3.754s including waiting). Image size: 224874686 bytes.

kuadrant-system

authorino-operator-7b7bb4bc77-llb2k_71037983-3160-4081-b8d9-ec7ce99393a1

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-llb2k_71037983-3160-4081-b8d9-ec7ce99393a1 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-jrmz4

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-llb2k

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.758s (2.758s including waiting). Image size: 167738465 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jrmz4

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-z6cfl

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-jrmz4

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-mx7rw_57d61756-73c6-46f9-86a8-5d9cea6884e8 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-llb2k

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-llb2k

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-z6cfl

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-z6cfl

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-z6cfl

Created

Container created

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-z6cfl

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-z6cfl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.311s (2.311s including waiting). Image size: 177967631 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jsjp8

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-jsjp8

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-578f754bb8 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-578f754bb8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-578f754bb8-9qfl4

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-578f754bb8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-578f754bb8-b8d6c

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-578f754bb8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-578f754bb8-jpjkp

kuadrant-system

limitador-operator-controller-manager-5778bb4449-z6cfl_8bbf573b-5788-43c9-b3b4-afa3ff4ac3d3

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-z6cfl_8bbf573b-5788-43c9-b3b4-afa3ff4ac3d3 became leader

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-jsjp8

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l56rn

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jrmz4

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.11s (5.11s including waiting). Image size: 309650901 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-578f754bb8-jpjkp

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jrmz4

Started

Container started

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-l56rn

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-l56rn

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-jrmz4

Created

Container created

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-578f754bb8-b8d6c

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-578f754bb8-9qfl4

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l56rn

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jsjp8

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-l56rn

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jsjp8

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.07s (2.07s including waiting). Image size: 309650901 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-jsjp8

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4lgz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 7.637s (7.637s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4lgz

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-t4lgz

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-fsqhl

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-597b95cb84-fsqhl

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.264s (3.264s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-fsqhl
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.73s (3.73s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.579s (3.579s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 755ms (755ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 774ms (774ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-9qfl4

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-jpjkp

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-578f754bb8-jpjkp_26955afc-14bf-43a7-ba41-8c1ed9e1b45e

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-578f754bb8-jpjkp_26955afc-14bf-43a7-ba41-8c1ed9e1b45e became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 1.12s (1.12s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-578f754bb8-b8d6c

Started

Container started

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-597b95cb84-fsqhl

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.137s (5.137s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-fsqhl

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-fsqhl

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-pjgsf

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pjgsf

Killing

Stopping container manager

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-tp4dp"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-8q8t8"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-ingress

replicaset-controller

kube-auth-proxy-76f5684988

SuccessfulCreate

Created pod: kube-auth-proxy-76f5684988-x9n4b

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-76f5684988 from 0 to 2

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-ingress

replicaset-controller

kube-auth-proxy-76f5684988

SuccessfulCreate

Created pod: kube-auth-proxy-76f5684988-h5t9m

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c4c65fbf-ccbt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c4c65fbf-ccbt2

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-ingress

multus

kube-auth-proxy-76f5684988-x9n4b

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-76f5684988-h5t9m

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-h5t9m

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-c4c65fbf from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-c4c65fbf

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-c4c65fbf-ccbt2

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-x9n4b

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-c4c65fbf-ccbt2

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c4c65fbf-ccbt2

Started

Container started

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-848d766f4b

SuccessfulCreate

Created pod: jobset-controller-manager-848d766f4b-729lf

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-x9n4b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.677s (2.677s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-x9n4b

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-h5t9m

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-h5t9m

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-l56rn_6d182e89-999f-44c3-8af3-336c56ebeff2

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-l56rn_6d182e89-999f-44c3-8af3-336c56ebeff2 became leader

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-h5t9m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.664s (2.664s including waiting). Image size: 188904677 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-848d766f4b from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-ingress

kubelet

kube-auth-proxy-76f5684988-x9n4b

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-848d766f4b-729lf

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-848d766f4b-729lf

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-74dfcfb894-r74s8

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-r74s8

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-r74s8

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-9cb85

kuadrant-system

multus

authorino-57f7f8659f-9cb85

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-848d766f4b-729lf

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-9cb85

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-jobset-operator

kubelet

jobset-controller-manager-848d766f4b-729lf

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.667s (3.667s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-848d766f4b-729lf

Created

Container created

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-frd55

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-4xv26

openshift-jobset-operator

jobset-controller-manager-848d766f4b-729lf_515a8a4e-9837-486d-89fd-5f739d983580

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-848d766f4b-729lf_515a8a4e-9837-486d-89fd-5f739d983580 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-r74s8

Created

Container created

kuadrant-system

multus

limitador-limitador-7c9b87d574-4xv26

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-r74s8

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4xv26

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

authorino-56c6c9ddd5-frd55

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-frd55

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-r74s8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.441s (3.441s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4xv26

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.022s (2.022s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4xv26

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4xv26

Started

Container started

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-fhwfv

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-fhwfv

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-9cb85

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-9cb85

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fhwfv

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

kubelet

authorino-57f7f8659f-9cb85

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 6.432s (6.432s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-frd55

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-frd55

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-frd55

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 4.693s (4.693s including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-9cb85

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fhwfv

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fhwfv

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-fhwfv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.679s (1.679s including waiting). Image size: 195729000 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

authorino-57f7f8659f-9cb85

Killing

Stopping container authorino

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-r74s8

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-r74s8

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-fhwfv_42a7926f-cb31-49a8-8e0f-09d73d14e2ea

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-fhwfv_42a7926f-cb31-49a8-8e0f-09d73d14e2ea became leader

opendatahub

replicaset-controller

maas-controller-65c8fd6c86

SuccessfulCreate

Created pod: maas-controller-65c8fd6c86-kxlpc

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-65c8fd6c86 from 0 to 1

opendatahub

kubelet

maas-controller-65c8fd6c86-kxlpc

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:356cd2269b91540225ba8c5d3c30e17eaeb351bfed5b25668fe7807d3e1f771c"

opendatahub

multus

maas-controller-65c8fd6c86-kxlpc

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-655bd8bb49 from 0 to 1

opendatahub

replicaset-controller

maas-controller-655bd8bb49

SuccessfulCreate

Created pod: maas-controller-655bd8bb49-gwsxw

opendatahub

kubelet

maas-controller-655bd8bb49-gwsxw

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:356cd2269b91540225ba8c5d3c30e17eaeb351bfed5b25668fe7807d3e1f771c"

opendatahub

multus

maas-controller-655bd8bb49-gwsxw

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-65c8fd6c86-kxlpc

Started

Container started

opendatahub

kubelet

maas-controller-655bd8bb49-gwsxw

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:356cd2269b91540225ba8c5d3c30e17eaeb351bfed5b25668fe7807d3e1f771c" in 5.894s (5.894s including waiting). Image size: 200069654 bytes.

opendatahub

kubelet

maas-controller-65c8fd6c86-kxlpc

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:356cd2269b91540225ba8c5d3c30e17eaeb351bfed5b25668fe7807d3e1f771c" in 6.711s (6.711s including waiting). Image size: 200069654 bytes.

opendatahub

kubelet

maas-controller-655bd8bb49-gwsxw

Created

Container created

opendatahub

kubelet

maas-controller-655bd8bb49-gwsxw

Started

Container started

opendatahub

kubelet

maas-controller-65c8fd6c86-kxlpc

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

maas-controller-655bd8bb49-gwsxw_f039c13f-fb20-42c1-8f11-a613b80ff2f9

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-655bd8bb49-gwsxw_f039c13f-fb20-42c1-8f11-a613b80ff2f9 became leader

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-q5v68

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-q5v68

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-q5v68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-q5v68

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-q5v68

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-q5v68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-q5v68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

multus

model-serving-api-75bd89fdfc-lv5fm

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-xpm8h

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-l88st

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wvwtp

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-lwspj

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-wvwtp

opendatahub

kubelet

kserve-controller-manager-776cc66d47-lwspj

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-lv5fm

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-wvwtp

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-lwspj

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-xpm8h

Killing

Stopping container discovery

opendatahub

kubelet

model-serving-api-75bd89fdfc-lv5fm

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

odh-model-controller-769875db56-l88st

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-l88st

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wvwtp

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wvwtp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.209s (2.209s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wvwtp

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-lv5fm

Started

Container started

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-65c8fd6c86 from 1 to 0

opendatahub

replicaset-controller

maas-controller-65c8fd6c86

SuccessfulDelete

Deleted pod: maas-controller-65c8fd6c86-kxlpc

opendatahub

kubelet

model-serving-api-75bd89fdfc-lv5fm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.262s (3.262s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-lv5fm

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-l88st

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.171s (3.171s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

maas-controller-65c8fd6c86-kxlpc

Killing

Stopping container manager

opendatahub

kubelet

odh-model-controller-769875db56-l88st

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-l88st

Started

Container started

opendatahub

odh-model-controller-769875db56-l88st_cdcfe731-f2e9-4828-9e48-751e877ab9c4

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-l88st_cdcfe731-f2e9-4828-9e48-751e877ab9c4 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-wvwtp_4ab3b957-aa7b-4f1e-9518-24cff5341d24

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-wvwtp_4ab3b957-aa7b-4f1e-9518-24cff5341d24 became leader

opendatahub

kubelet

kserve-controller-manager-776cc66d47-lwspj

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-lwspj

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 4.584s (4.584s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-lwspj

Created

Container created

opendatahub

kserve-controller-manager-776cc66d47-lwspj_2bb0a625-2aec-4f83-b2d9-d579dba73dfb

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-lwspj_2bb0a625-2aec-4f83-b2d9-d579dba73dfb became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-qf8tr

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 12.856s (12.856s including waiting). Image size: 1089502687 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-6rpqq

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-65ff45b778 from 1 to 0

kuadrant-system

replicaset-controller

authorino-65ff45b778

SuccessfulDelete

Deleted pod: authorino-65ff45b778-96hwh

kuadrant-system

kubelet

authorino-6f6944bcdd-6rpqq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Created

Container created

kuadrant-system

multus

authorino-6f6944bcdd-6rpqq

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-76c6d89db4

SuccessfulCreate

Created pod: authorino-76c6d89db4-xk9l6

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-76c6d89db4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-65ff45b778 from 0 to 1

kuadrant-system

replicaset-controller

authorino-65ff45b778

SuccessfulCreate

Created pod: authorino-65ff45b778-96hwh

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-6rpqq

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

multus

authorino-76c6d89db4-xk9l6

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

kuadrant-system

multus

authorino-65ff45b778-96hwh

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-65ff45b778-96hwh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-76c6d89db4-xk9l6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

authorino-65ff45b778-96hwh

Started

Container started

kuadrant-system

kubelet

authorino-65ff45b778-96hwh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.418s (1.419s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-6rpqq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

authorino-6f6944bcdd-6rpqq

Started

Container started

kuadrant-system

kubelet

authorino-65ff45b778-96hwh

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-6rpqq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.808s (1.808s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-6rpqq

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-65ff45b778-96hwh

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-76c6d89db4-xk9l6

Created

Container created

kuadrant-system

kubelet

authorino-76c6d89db4-xk9l6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.396s (1.396s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-76c6d89db4-xk9l6

Started

Container started

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-frd55

kuadrant-system

kubelet

authorino-56c6c9ddd5-frd55

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-w6rkh

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-w6rkh

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-w6rkh

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-w6rkh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 677ms (677ms including waiting). Image size: 235100981 bytes.

opendatahub

multus

llmisvc-controller-manager-6466c554d8-w6rkh

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-w6rkh

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-wvwtp

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-wvwtp

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-x6vsn

opendatahub

multus

ai-gateway-controller-7d85675f98-x6vsn

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x6vsn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x6vsn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.62s (2.62s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x6vsn

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x6vsn

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-x6vsn_c53a3c6e-4992-4feb-877f-b5293913a467

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-x6vsn_c53a3c6e-4992-4feb-877f-b5293913a467 became leader
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-hg9wk

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-2szkr

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hg9wk

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-hg9wk

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2szkr

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-2szkr

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2szkr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.87s (2.87s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hg9wk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2szkr

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hg9wk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.097s (3.097s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-2szkr

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-hg9wk

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-w6rkh_771a161f-ca4f-43c0-b4db-1555136acae9

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-w6rkh_771a161f-ca4f-43c0-b4db-1555136acae9 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6467c7bcbb from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-6467c7bcbb

SuccessfulCreate

Created pod: ai-gateway-controller-6467c7bcbb-q6mdg

opendatahub

multus

ai-gateway-controller-6467c7bcbb-q6mdg

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6467c7bcbb-q6mdg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-6467c7bcbb-q6mdg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 846ms (846ms including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-6467c7bcbb-q6mdg

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6467c7bcbb-q6mdg

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-x6vsn

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-x6vsn

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

ai-gateway-controller-6467c7bcbb-q6mdg_fac973d1-bb1a-4e24-a97e-7ce2d92665a6

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6467c7bcbb-q6mdg_fac973d1-bb1a-4e24-a97e-7ce2d92665a6 became leader

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.574s (2.574s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-8hvht

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-5xgvw

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5xgvw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 585ms (585ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5xgvw

Created

Container created

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-5xgvw

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5xgvw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5xgvw

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-kvcc8

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-kvcc8

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-kvcc8

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-kvcc8

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.455s (1.455s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-kvcc8

Started

Container started

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-874n7

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-kvcc8

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-874n7

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-874n7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-874n7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 609ms (609ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-874n7

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-874n7

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 576ms (576ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85cglq

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-bfhs7

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-bfhs7

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bfhs7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bfhs7

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bfhs7

Created

Container created

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-bfhs7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.27s (2.27s including waiting). Image size: 78208878 bytes.

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 597ms (597ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-qjj6n

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 589ms (589ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-fjr78

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-dnh58

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-j4c2z

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-fjr78

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j4c2z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-dnh58

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-dnh58

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-dnh58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-dnh58

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-j4c2z

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j4c2z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.78s (3.78s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j4c2z

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j4c2z

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.415s (4.415s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-dnh58

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-dnh58

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j4c2z

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j4c2z

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

kuadrant-system

replicaset-controller

authorino-77dd9fff5

SuccessfulCreate

Created pod: authorino-77dd9fff5-h8rlb
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:

kuadrant-system

multus

authorino-77dd9fff5-h8rlb

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-77dd9fff5-h8rlb

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-77dd9fff5-h8rlb

Created

Container created

kuadrant-system

kubelet

authorino-77dd9fff5-h8rlb

Started

Container started

kuadrant-system

kubelet

authorino-77dd9fff5-h8rlb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.345s (1.345s including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-76c6d89db4 from 1 to 0

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 4 to 7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-mgw8n

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

kuadrant-system

kubelet

authorino-76c6d89db4-xk9l6

Killing

Stopping container authorino

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-r6nlx

kuadrant-system

replicaset-controller

authorino-76c6d89db4

SuccessfulDelete

Deleted pod: authorino-76c6d89db4-xk9l6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-hfxrj

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-hfxrj

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mgw8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mgw8n

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mgw8n

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-mgw8n

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-r6nlx

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

Created

Container created
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mgw8n

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mgw8n

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-f20e6e5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f20e6e5e

openshift-ingress

gateway_labeler_controller

e2e-migrate-c6317794-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c6317794-gw

openshift-ingress

deployment-controller

e2e-migrate-c6317794-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c6317794-gw-openshift-default-8585ff86fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc

SuccessfulCreate

Created pod: e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

openshift-ingress

replicaset-controller

e2e-ait-f20e6e5e-openshift-default-7f98b64d97

SuccessfulCreate

Created pod: e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

openshift-ingress

deployment-controller

e2e-ait-f20e6e5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f20e6e5e-openshift-default-7f98b64d97 from 0 to 1

openshift-ingress

multus

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-6996ffc6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6996ffc6

openshift-ingress

deployment-controller

e2e-ait-6996ffc6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6996ffc6-openshift-default-6f99ccc9c5 from 0 to 1

openshift-ingress

multus

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5

SuccessfulCreate

Created pod: e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c6317794

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c6317794-964dbb7c9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c6317794: serviceaccount "payload-processing-e2e-migrate-c6317794" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c6317794-bf87cd95c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c6317794-bf87cd95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c6317794: serviceaccount "payload-processing-e2e-migrate-c6317794" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c6317794-bf87cd95c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c6317794

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c6317794-bf87cd95c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ait-282df361

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-282df361

openshift-ingress

kubelet

payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww

Started

Container started

openshift-ingress

deployment-controller

e2e-ait-282df361-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-282df361-openshift-default-66dc8d7489 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-282df361-openshift-default-66dc8d7489

SuccessfulCreate

Created pod: e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

openshift-ingress

multus

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f20e6e5e: serviceaccount "payload-processing-e2e-ait-f20e6e5e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f20e6e5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f20e6e5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f20e6e5e-7df5c7ff47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f20e6e5e: serviceaccount "payload-processing-e2e-ait-f20e6e5e" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6996ffc6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6996ffc6-5cbc494b49 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6996ffc6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6996ffc6: serviceaccount "payload-processing-e2e-ait-6996ffc6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6996ffc6-5cbc494b49

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6996ffc6-5cbc494b49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6996ffc6: serviceaccount "payload-processing-e2e-ait-6996ffc6" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6996ffc6-5cbc494b49

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

openshift-ingress

kubelet

payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 858ms (858ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.254s (3.254s including waiting). Image size: 125353965 bytes.

openshift-ingress

multus

payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 857ms (857ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-282df361-6b5ffbdc95

FailedCreate

Error creating: pods "payload-processing-e2e-ait-282df361-6b5ffbdc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-282df361: serviceaccount "payload-processing-e2e-ait-282df361" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-282df361-b8756946c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-282df361-b8756946c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-282df361: serviceaccount "payload-processing-e2e-ait-282df361" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-282df361

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-282df361-6b5ffbdc95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-282df361

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-282df361-b8756946c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-282df361-b8756946c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-282df361-6b5ffbdc95

SuccessfulCreate

Created pod: payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t

openshift-ingress

multus

payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-derive-c678f1ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c678f1ee

openshift-ingress

replicaset-controller

e2e-derive-c678f1ee-openshift-default-67f6bdd7c

SuccessfulCreate

Created pod: e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

openshift-ingress

deployment-controller

e2e-derive-c678f1ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c678f1ee-openshift-default-67f6bdd7c from 0 to 1

openshift-ingress

multus

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-c6317794-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-c6317794-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

Started

Container started

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c678f1ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c678f1ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c678f1ee-696947bfcc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c678f1ee-696947bfcc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c678f1ee-696947bfcc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c678f1ee-696947bfcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c678f1ee: serviceaccount "payload-processing-e2e-derive-c678f1ee" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c678f1ee: serviceaccount "payload-processing-e2e-derive-c678f1ee" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-c6317794-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-c6317794-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6996ffc6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6996ffc6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-282df361-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-282df361-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-c6317794-bf87cd95c-k76ww

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c6317794-964dbb7c9-s2mhl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-e90e35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-e90e35

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f20e6e5e-586f7fd7f5-4hmrs

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

openshift-ingress

kubelet

payload-processing-e2e-ait-f20e6e5e-7df5c7ff47-29bmk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f20e6e5e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6996ffc6-546d54f6dc-l5dkc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6996ffc6-5cbc494b49-vjdt8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-f20e6e5e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

Created

Container created

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6996ffc6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-migrate-c6317794-gw-openshift-default-8585ff86fc-wtqrr

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-6996ffc6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-e90e35-8647584c55

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-e90e35: serviceaccount "payload-processing-e2e-worker-w3-e90e35" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-e90e35

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-e90e35-8647584c55

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-e90e35-8647584c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-e90e35: serviceaccount "payload-processing-e2e-worker-w3-e90e35" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-e90e35

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-e90e35-8647584c55 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt

Started

Container started

openshift-ingress

kubelet

e2e-ait-6996ffc6-openshift-default-6f99ccc9c5-8hpvm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-b8717e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-b8717e

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-282df361-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 0 to 1

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-282df361-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-282df361-6b5ffbdc95-8k96t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-282df361-b8756946c-4rvvj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f20e6e5e-openshift-default-7f98b64d97-g75fh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-282df361-openshift-default-66dc8d7489-ntrhl

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-d2a3e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-d2a3e0

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-90e0d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-90e0d5

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 0 to 1

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-b8717e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-b8717e-66555bd5dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-b8717e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-b8717e-66555bd5dc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-b8717e-66555bd5dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-b8717e: serviceaccount "payload-processing-e2e-worker-w0-b8717e" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-b8717e: serviceaccount "payload-processing-e2e-worker-w0-b8717e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-b8717e-66555bd5dc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72

openshift-ingress

multus

payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-c678f1ee-696947bfcc-5r85p

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-c678f1ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-c678f1ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c678f1ee-6f4f646dc-w8xrd

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-90e0d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-90e0d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-90e0d5: serviceaccount "payload-processing-e2e-worker-w2-90e0d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-90e0d5: serviceaccount "payload-processing-e2e-worker-w2-90e0d5" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-d2a3e0: serviceaccount "payload-processing-e2e-worker-w4-d2a3e0" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-d2a3e0: serviceaccount "payload-processing-e2e-worker-w4-d2a3e0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-d2a3e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-d2a3e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-c678f1ee-openshift-default-67f6bdd7c-gvm8g

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-1c3eef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-1c3eef

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-1c3eef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-1c3eef-579584b4c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-1c3eef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-1c3eef-579584b4c9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-1c3eef-579584b4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-1c3eef: serviceaccount "payload-processing-e2e-worker-w1-1c3eef" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-1c3eef: serviceaccount "payload-processing-e2e-worker-w1-1c3eef" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-1c3eef-579584b4c9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

openshift-ingress

multus

payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-xxpxm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-dnh58

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 7 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-dnh58

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-xxpxm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Created

Container created

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5577b47559 from 0 to 1
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-5577b47559

FailedCreate

Error creating: pods "payload-processing-external-model-5577b47559-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5577b47559

SuccessfulCreate

Created pod: payload-processing-external-model-5577b47559-4ll85

models-as-a-service

kubelet

payload-processing-external-model-5577b47559-4ll85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5577b47559-4ll85

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5577b47559-4ll85

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5577b47559-4ll85

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 5 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-r6sd2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-c7s57

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-r6sd2

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-c7s57

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-tdqzj

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-86d8965798

SuccessfulCreate

Created pod: payload-processing-external-model-86d8965798-5kppx

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-86d8965798 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-86d8965798-5kppx

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-86d8965798-5kppx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-86d8965798-5kppx

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-86d8965798-5kppx

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 8 to 10
(x3)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-694db55c87-krsdr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-krsdr

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-bm2hx

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

models-as-a-service

kubelet

payload-processing-external-model-5577b47559-4ll85

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-501bd36994fb" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-66f8fcd7fb

SuccessfulCreate

Created pod: payload-processing-external-model-66f8fcd7fb-j5swv

models-as-a-service

kubelet

payload-processing-external-model-86d8965798-5kppx

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-86d8965798

SuccessfulDelete

Deleted pod: payload-processing-external-model-86d8965798-5kppx

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-86d8965798 from 1 to 0
(x10)

models-as-a-service

kubelet

payload-processing-external-model-86d8965798-5kppx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

multus

payload-processing-external-model-66f8fcd7fb-j5swv

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-j5swv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-j5swv

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-j5swv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

models-as-a-service

kubelet

payload-processing-external-model-86d8965798-5kppx

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-7513640d12da" not found
(x3)

models-as-a-service

kubelet

payload-processing-external-model-5577b47559-4ll85

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-7513640d12da" not found

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 3 to 5
(x7)

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-j5swv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-747d767c44 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-747d767c44

SuccessfulCreate

Created pod: payload-processing-external-model-747d767c44-v9lrd

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-66f8fcd7fb

SuccessfulDelete

Deleted pod: payload-processing-external-model-66f8fcd7fb-j5swv

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-66f8fcd7fb from 1 to 0

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-j5swv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-747d767c44-v9lrd

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-747d767c44-v9lrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-747d767c44-v9lrd

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-747d767c44-v9lrd

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 1 to 2

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-5577b47559

SuccessfulDelete

Deleted pod: payload-processing-external-model-5577b47559-4ll85

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5577b47559 from 1 to 0

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Created

Container created

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5577b47559-4ll85

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

Started

Container started

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

Started

Container started

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 4 to 6

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

Created

Container created

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 5 to 7

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

Started

Container started

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-66f8fcd7fb

SuccessfulCreate

Created pod: payload-processing-external-model-66f8fcd7fb-7jxn7
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-66f8fcd7fb from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-7jxn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-7jxn7

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-7jxn7

Started

Container started

models-as-a-service

multus

payload-processing-external-model-66f8fcd7fb-7jxn7

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 4 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

Created

Container created

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x3)

models-as-a-service

kubelet

payload-processing-external-model-747d767c44-v9lrd

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-32223ebd7979" not found, secret "agc-cred-6ede377aee21" not found]
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-7jxn7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-747d767c44-v9lrd

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-66f8fcd7fb-7jxn7

Killing

Stopping container payload-processing
(x2)

models-as-a-service

kubelet

payload-processing-external-model-747d767c44-v9lrd

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-32223ebd7979" not found, secret "agc-cred-501bd36994fb" not found, secret "agc-cred-6ede377aee21" not found]

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Unhealthy

Readiness probe failed: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

ProbeError

Readiness probe error: Get "http://10.132.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

Unhealthy

Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 6 to 8

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulCreate

Created pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

Started

Container started

openshift-ingress

multus

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

Created

Container created

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

Started

Container started

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Started

Container started

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Unhealthy

Liveness probe failed: Get "https://10.132.0.55:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Unhealthy

Readiness probe failed: Get "https://10.132.0.55:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

ProbeError

Readiness probe error: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Unhealthy

Readiness probe failed: Get "http://10.134.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Unhealthy

Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-7fabe91d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7fabe91d

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Unhealthy

Readiness probe failed: Get "https://10.132.0.55:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x11)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-7fabe91d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7fabe91d-openshift-default-bc7cfb59c from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h
(x12)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x13)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x11)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

Started

Container started

openshift-ingress

multus

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-5r74g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 8 to 10

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

ProbeError

Readiness probe error: Get "http://10.132.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Unhealthy

Readiness probe failed: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

ProbeError

Readiness probe error: Get "http://10.133.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

Started

Container started
(x4)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-jgrlq

Unhealthy

Readiness probe failed: Get "https://10.132.0.55:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7fabe91d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7fabe91d-77674764ff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7fabe91d-77674764ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7fabe91d-77674764ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7fabe91d: serviceaccount "payload-processing-e2e-mt-7fabe91d" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7fabe91d-669dbb6fdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7fabe91d-669dbb6fdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7fabe91d: serviceaccount "payload-processing-e2e-mt-7fabe91d" not found

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7fabe91d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7fabe91d-669dbb6fdf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7fabe91d-77674764ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

openshift-ingress

multus

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7fabe91d-669dbb6fdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 1 to 3

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

Started

Container started

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-c9rwj

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.878s (3.878s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-c9rwj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

ProbeError

Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

Unhealthy

Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mgw8n

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mgw8n

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-api-a-9ac4a7-openshift-default-5b885745c5

SuccessfulCreate

Created pod: e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

openshift-ingress

deployment-controller

e2e-api-a-9ac4a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9ac4a7-openshift-default-5b885745c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-9ac4a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9ac4a7

openshift-ingress

multus

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-da0f3d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-da0f3d

openshift-ingress

deployment-controller

e2e-api-a-da0f3d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-da0f3d-openshift-default-d6fdb46d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-da0f3d-openshift-default-d6fdb46d9

SuccessfulCreate

Created pod: e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

openshift-ingress

multus

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7fabe91d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7fabe91d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9ac4a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9ac4a7-698788cc4f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9ac4a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9ac4a7-698788cc4f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9ac4a7-698788cc4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9ac4a7: serviceaccount "payload-processing-e2e-api-a-9ac4a7" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9ac4a7: serviceaccount "payload-processing-e2e-api-a-9ac4a7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9ac4a7-698788cc4f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v

openshift-ingress

multus

payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-da0f3d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-da0f3d-5975685759 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-da0f3d-5975685759

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-da0f3d: serviceaccount "payload-processing-e2e-api-a-da0f3d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-da0f3d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-da0f3d-cc6c6bdc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-da0f3d-5975685759

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-da0f3d-5975685759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-da0f3d: serviceaccount "payload-processing-e2e-api-a-da0f3d" not found

openshift-ingress

multus

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l

openshift-ingress

multus

payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.582s (2.582s including waiting). Image size: 125353965 bytes.

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-da0f3d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-da0f3d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7fabe91d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7fabe91d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9ac4a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9ac4a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-a-d73ad7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d73ad7-openshift-default-77fbb68489 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-d73ad7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d73ad7

openshift-ingress

multus

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-d73ad7-openshift-default-77fbb68489

SuccessfulCreate

Created pod: e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 5 to 10

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d73ad7: serviceaccount "payload-processing-e2e-api-a-d73ad7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d73ad7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d73ad7-84cf749d95

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d73ad7-84cf749d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d73ad7: serviceaccount "payload-processing-e2e-api-a-d73ad7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d73ad7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d73ad7-84cf749d95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d73ad7-84cf749d95

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp

Started

Container started

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-api-b-02a8fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-02a8fa-openshift-default-79878d864c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-02a8fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-02a8fa

openshift-ingress

replicaset-controller

e2e-api-b-02a8fa-openshift-default-79878d864c

SuccessfulCreate

Created pod: e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

openshift-ingress

multus

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9ac4a7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-9ac4a7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-479363-openshift-default-78d54cdf47

SuccessfulCreate

Created pod: e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

openshift-ingress

deployment-controller

e2e-api-b-479363-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-479363-openshift-default-78d54cdf47 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-479363

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-479363

openshift-ingress

multus

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-02a8fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-02a8fa-6987989665 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-02a8fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-02a8fa-6987989665

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-02a8fa-6987989665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-02a8fa: serviceaccount "payload-processing-e2e-api-b-02a8fa" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-02a8fa: serviceaccount "payload-processing-e2e-api-b-02a8fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-02a8fa-6987989665

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-02a8fa-6987989665-drfl8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-02a8fa-6987989665-drfl8

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-02a8fa-6987989665-drfl8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-02a8fa-6987989665-drfl8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-02a8fa-6987989665-drfl8

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-479363-d9446c767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-479363-d9446c767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-479363: serviceaccount "payload-processing-e2e-api-b-479363" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-479363

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-479363-d9446c767 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-479363

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-479363-96bb58d89 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-479363-96bb58d89

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-479363-96bb58d89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-479363: serviceaccount "payload-processing-e2e-api-b-479363" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-da0f3d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-479363-d9446c767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-da0f3d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-479363-96bb58d89

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-479363-96bb58d89-lv8jl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-479363-96bb58d89-lv8jl

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-479363-96bb58d89-lv8jl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-479363-96bb58d89-lv8jl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-479363-96bb58d89-lv8jl

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-479363-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-479363-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-7376-8a35a5

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7376-8a35a5

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x2)

openshift-ingress

kubelet

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7376-8a35a5

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 10.64s (10.64s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7376-8a35a5

Created

Container created

opendatahub

kubelet

test-curl-7376-8a35a5

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7

SuccessfulCreate

Created pod: e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

openshift-ingress

deployment-controller

e2e-ipp-a-97ca39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-97ca39-openshift-default-759c9cfdb7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-97ca39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-97ca39

openshift-ingress

multus

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97ca39-864dc78c4f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-97ca39-864dc78c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97ca39: serviceaccount "payload-processing-e2e-ipp-a-97ca39" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-97ca39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-97ca39-595d567959 from 0 to 1

opendatahub

kubelet

test-curl-7376-8a35a5

Killing

Stopping container test-curl-7376-8a35a5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97ca39-595d567959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-97ca39-595d567959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97ca39: serviceaccount "payload-processing-e2e-ipp-a-97ca39" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-97ca39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-97ca39-864dc78c4f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97ca39-595d567959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97ca39-864dc78c4f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz

Created

Container created

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

Unhealthy

Readiness probe failed: Get "http://10.132.0.114:15021/healthz/ready": read tcp 10.132.0.2:52798->10.132.0.114:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

ProbeError

Readiness probe error: Get "http://10.132.0.114:15021/healthz/ready": read tcp 10.132.0.2:52798->10.132.0.114:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d73ad7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-d73ad7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-02a8fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-02a8fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-b-2bc5e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2bc5e3

openshift-ingress

replicaset-controller

e2e-api-b-2bc5e3-openshift-default-56d8586b4c

SuccessfulCreate

Created pod: e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

openshift-ingress

deployment-controller

e2e-api-b-2bc5e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2bc5e3-openshift-default-56d8586b4c from 0 to 1

openshift-ingress

multus

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2bc5e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2bc5e3-7764484d9c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2bc5e3: serviceaccount "payload-processing-e2e-api-b-2bc5e3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2bc5e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2bc5e3-7764484d9c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2bc5e3-7764484d9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2bc5e3: serviceaccount "payload-processing-e2e-api-b-2bc5e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2bc5e3-7764484d9c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-02a8fa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-02a8fa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-csvrv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-tshgn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-479363-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-479363-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9ac4a7-99d55f65f-dttp6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9ac4a7-698788cc4f-p2v7v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cxz2q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-dh2fp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-lxdn7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 10 to 4

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-pmb6g

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hdn5p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 10 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

ProbeError

Readiness probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-nsftk

Unhealthy

Readiness probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-428wt

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cgbtc

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-da0f3d-5975685759-qxn45

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-da0f3d-cc6c6bdc9-p5r7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-kpb9k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-7xnrr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-77k57

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-2j8mp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-qw9sz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-97ca39-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-97ca39-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-xxzz2

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-nx6b8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-59772

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

Unhealthy

Readiness probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-d28jw

ProbeError

Readiness probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ptlsh

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z7bsr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 10 to 6

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-qqt5b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-595d567959-tn2pz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-864dc78c4f-6l2dz

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-j4c2z

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-bm2hx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j4c2z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-krsdr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 10 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-hfxrj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-tdqzj

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-pfr2n

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-7fbtp

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-hfxrj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tdqzj

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bm2hx

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-krsdr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 6 to 4
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-97ca39-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-97ca39-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fcg9p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-z9fkd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

Created

Container created

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-9ac4a7-openshift-default-5b885745c5-hjz5s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-da0f3d-openshift-default-d6fdb46d9-lnxk4

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2bc5e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2bc5e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-b-02a8fa-6987989665-drfl8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02a8fa-54db49f4d7-qqrb6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7fabe91d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7fabe91d-669dbb6fdf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7fabe91d-669dbb6fdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7fabe91d-669dbb6fdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7fabe91d: serviceaccount "payload-processing-e2e-mt-7fabe91d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7fabe91d-669dbb6fdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7fabe91d-77674764ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7fabe91d-77674764ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7fabe91d-77674764ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7fabe91d: serviceaccount "payload-processing-e2e-mt-7fabe91d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7fabe91d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7fabe91d-77674764ff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d73ad7-84cf749d95-786wp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-97ca39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d73ad7-5ccfcbb867-g7mgx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-97ca39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-97ca39-574f455b47 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97ca39: serviceaccount "payload-processing-e2e-ipp-a-97ca39" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-97ca39: serviceaccount "payload-processing-e2e-ipp-a-97ca39" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-479363-96bb58d89-lv8jl

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-479363-d9446c767-kl9d9

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2bc5e3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2bc5e3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

openshift-ingress

multus

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.781s (2.781s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.321s (2.321s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-b-859078-openshift-default-7df4c8bc79

SuccessfulCreate

Created pod: e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

openshift-ingress

deployment-controller

e2e-ipp-b-859078-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-859078-openshift-default-7df4c8bc79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-859078

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-859078

openshift-ingress

multus

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-859078: serviceaccount "payload-processing-e2e-ipp-b-859078" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-859078

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-859078-65444c9ddc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-859078

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-859078-7dbf99bcd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-859078-7dbf99bcd9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-859078-7dbf99bcd9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-859078-7dbf99bcd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-859078: serviceaccount "payload-processing-e2e-ipp-b-859078" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7fabe91d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-7fabe91d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7fabe91d-openshift-default-bc7cfb59c from 1 to 4

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

Started

Container started

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

Started

Container started

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

Created

Container created

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

Started

Container started

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

Created

Container created

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

Created

Container created

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

opendatahub

multus

test-curl-7376-0d58d1

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7376-0d58d1

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 10 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-qr2zq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-md8vb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-kxvbg

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-7fabe91d-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

openshift-ingress

deployment-controller

e2e-mt-7fabe91d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7fabe91d-openshift-default-bc7cfb59c from 4 to 8

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

openshift-ingress

replicaset-controller

e2e-mt-7fabe91d-openshift-default-bc7cfb59c

SuccessfulCreate

Created pod: e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

Started

Container started

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

Started

Container started

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

Created

Container created

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

Started

Container started

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

Created

Container created

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

Created

Container created

openshift-ingress

multus

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

Started

Container started

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

Created

Container created

opendatahub

kubelet

test-curl-7376-0d58d1

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.508s (3.508s including waiting). Image size: 106100986 bytes.

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-j4s5v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7376-0d58d1

Created

Container created

opendatahub

kubelet

test-curl-7376-0d58d1

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-rnrsk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

Unhealthy

Readiness probe failed: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2zw5k

ProbeError

Readiness probe error: Get "http://10.132.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

opendatahub

kubelet

test-curl-7376-0d58d1

Killing

Stopping container test-curl-7376-0d58d1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-c7s57

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

Unhealthy

Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

ProbeError

Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

Unhealthy

Startup probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

ProbeError

Startup probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

ProbeError

Startup probe error: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

Unhealthy

Startup probe failed: Get "http://10.132.0.121:15021/healthz/ready": dial tcp 10.132.0.121:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c7s57

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-mt-7fabe91d-669dbb6fdf-2fmj4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7fabe91d-77674764ff-lkfw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-02a8fa-openshift-default-79878d864c-vfmcv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7a54db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7a54db

openshift-ingress

replicaset-controller

e2e-ipp-a-7a54db-openshift-default-68666f54f

SuccessfulCreate

Created pod: e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

openshift-ingress

deployment-controller

e2e-ipp-a-7a54db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7a54db-openshift-default-68666f54f from 0 to 1

openshift-ingress

multus

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-d73ad7-openshift-default-77fbb68489-qnfn4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7a54db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7a54db-58688547dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7a54db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7a54db-58688547dc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7a54db-58688547dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7a54db: serviceaccount "payload-processing-e2e-ipp-a-7a54db" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7a54db: serviceaccount "payload-processing-e2e-ipp-a-7a54db" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7a54db-58688547dc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-479363-openshift-default-78d54cdf47-cp5m7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-69a1d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-69a1d2

openshift-ingress

deployment-controller

e2e-ipp-a-69a1d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-69a1d2-openshift-default-987788949 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-69a1d2-openshift-default-987788949

SuccessfulCreate

Created pod: e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh
(x6)

openshift-ingress

kubelet

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-2bc5e3-7764484d9c-c4ddb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2bc5e3-84ddddc6c-cvl96

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-69a1d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-69a1d2-75ff567cf9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-69a1d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a1d2: serviceaccount "payload-processing-e2e-ipp-a-69a1d2" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a1d2: serviceaccount "payload-processing-e2e-ipp-a-69a1d2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-859078-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-859078-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-65444c9ddc-lgc9g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-7dbf99bcd9-pqdvm

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-5klsk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-bt2kz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-bf85j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-g5wxn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-r6sd2

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4cs6h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-xftsg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-4rfqv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-tmdqb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-88n5c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-bn65c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-blssm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7fabe91d-openshift-default-bc7cfb59c-pqfdj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6sd2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-859078

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-859078-795cf98998 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-859078

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-859078-7fc998f987 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-859078-7fc998f987

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-859078-7fc998f987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-859078: serviceaccount "payload-processing-e2e-ipp-b-859078" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-859078-795cf98998

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-859078-795cf98998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-859078: serviceaccount "payload-processing-e2e-ipp-b-859078" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-859078-7fc998f987

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-859078-795cf98998

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-859078-795cf98998-mghsr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-859078-795cf98998-mghsr

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-795cf98998-mghsr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-795cf98998-mghsr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-795cf98998-mghsr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7a54db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7a54db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-2bc5e3-openshift-default-56d8586b4c-xw7zq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-2edb49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2edb49-openshift-default-7fdb57977f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-2edb49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-2edb49
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-2edb49-openshift-default-7fdb57977f

SuccessfulCreate

Created pod: e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

openshift-ingress

multus

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a1d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a1d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2edb49: serviceaccount "payload-processing-e2e-ipp-a-2edb49" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2edb49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2edb49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2edb49-67f4b9854f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2edb49-67f4b9854f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2edb49-67f4b9854f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2edb49: serviceaccount "payload-processing-e2e-ipp-a-2edb49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2edb49-67f4b9854f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7a54db-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7a54db-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-55456b66d7-6jzfl

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-577ea8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-577ea8

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-58688547dc-jcngb

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-577ea8-openshift-default-654dd86f59

SuccessfulCreate

Created pod: e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

openshift-ingress

deployment-controller

e2e-ipp-b-577ea8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-577ea8-openshift-default-654dd86f59 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a1d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-69a1d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-577ea8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-577ea8-7987bc78f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-577ea8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-577ea8-7987bc78f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-577ea8-7987bc78f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-577ea8: serviceaccount "payload-processing-e2e-ipp-b-577ea8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-577ea8-7987bc78f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-577ea8: serviceaccount "payload-processing-e2e-ipp-b-577ea8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-75ff567cf9-jwtbg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-56b77c4f9f-2zct9

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 3 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-pqpw6

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-4bfdv

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-c8sl7

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-pqpw6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-4bfdv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-c8sl7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

ProbeError

Startup probe error: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

Unhealthy

Startup probe failed: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-bxr9x

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lzkmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-bxr9x

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-msm7m

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 6 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-j249g

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j249g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-j249g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-lzkmk

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-lzkmk

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j249g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lzkmk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lzkmk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j249g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-msm7m

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-msm7m

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-msm7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-msm7m

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lzkmk

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-msm7m

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j249g

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j249g

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-msm7m

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lzkmk

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-577ea8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-577ea8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7a54db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7a54db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7a54db: serviceaccount "payload-processing-e2e-ipp-a-7a54db" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7a54db: serviceaccount "payload-processing-e2e-ipp-a-7a54db" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-97ca39-574f455b47-cb692

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-97ca39-7dfd9c7df8-5dpww

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-97ca39-openshift-default-759c9cfdb7-k4g5s

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-69a1d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2edb49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a1d2: serviceaccount "payload-processing-e2e-ipp-a-69a1d2" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2edb49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-69a1d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-69a1d2: serviceaccount "payload-processing-e2e-ipp-a-69a1d2" not found
(x5)

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

ProbeError

Startup probe error: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k
(x5)

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

Unhealthy

Startup probe failed: Get "http://10.132.0.127:15021/healthz/ready": dial tcp 10.132.0.127:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-859078-7fc998f987-m9hx9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-859078-795cf98998-mghsr

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a28730

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a28730

openshift-ingress

replicaset-controller

e2e-ipp-b-a28730-openshift-default-5dd7449995

SuccessfulCreate

Created pod: e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

openshift-ingress

deployment-controller

e2e-ipp-b-a28730-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a28730-openshift-default-5dd7449995 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

ProbeError

Readiness probe error: Get "http://10.133.0.128:15021/healthz/ready": read tcp 10.133.0.2:51420->10.133.0.128:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

Unhealthy

Readiness probe failed: Get "http://10.133.0.128:15021/healthz/ready": read tcp 10.133.0.2:51420->10.133.0.128:15021: read: connection reset by peer

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a28730: serviceaccount "payload-processing-e2e-ipp-b-a28730" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a28730

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a28730-59d784d8c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a28730-7c7fc89749

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a28730-7c7fc89749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a28730: serviceaccount "payload-processing-e2e-ipp-b-a28730" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a28730

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a28730-7c7fc89749 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a28730-7c7fc89749

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

Unhealthy

Startup probe failed: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

ProbeError

Startup probe error: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2edb49-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2edb49-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-859078-openshift-default-7df4c8bc79-b55rc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d66ae6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d66ae6

openshift-ingress

deployment-controller

e2e-ipp-b-96567a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-96567a-openshift-default-564c67b55c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-96567a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-96567a

openshift-ingress

replicaset-controller

e2e-ipp-b-96567a-openshift-default-564c67b55c

SuccessfulCreate

Created pod: e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-66cfb8678c-4vtvn

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-praxis-a-d66ae6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d66ae6-openshift-default-675d86cfd5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-67f4b9854f-zzgns

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5

SuccessfulCreate

Created pod: e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

openshift-ingress

multus

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-96567a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-96567a-b8d48f6b7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-96567a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-96567a-9847b887 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-96567a-b8d48f6b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-96567a-b8d48f6b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-96567a-b8d48f6b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-96567a: serviceaccount "payload-processing-e2e-ipp-b-96567a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-96567a-9847b887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-96567a-9847b887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-96567a-9847b887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-96567a: serviceaccount "payload-processing-e2e-ipp-b-96567a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d66ae6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d66ae6-754d795479 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d66ae6-754d795479

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d66ae6-754d795479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d66ae6: serviceaccount "payload-processing-e2e-praxis-a-d66ae6" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d66ae6: serviceaccount "payload-processing-e2e-praxis-a-d66ae6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d66ae6-754d795479

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d66ae6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-577ea8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-577ea8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2jl2p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-7987bc78f7-p6682

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-8fb7c9795-p84km

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2edb49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2edb49-78d986d578 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2edb49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2edb49-78d986d578

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2edb49-78d986d578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2edb49: serviceaccount "payload-processing-e2e-ipp-a-2edb49" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2edb49: serviceaccount "payload-processing-e2e-ipp-a-2edb49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2edb49-78d986d578

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a28730-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a28730-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

Unhealthy

Startup probe failed: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

ProbeError

Startup probe error: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-8b1e0a-openshift-default-5f759d897

SuccessfulCreate

Created pod: e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

openshift-ingress

deployment-controller

e2e-ipp-a-8b1e0a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8b1e0a-openshift-default-5f759d897 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8b1e0a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8b1e0a

openshift-ingress

multus

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-577ea8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-577ea8-64c56bb4db from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-577ea8-64c56bb4db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-577ea8-64c56bb4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-577ea8: serviceaccount "payload-processing-e2e-ipp-b-577ea8" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-577ea8: serviceaccount "payload-processing-e2e-ipp-b-577ea8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-577ea8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-577ea8-64c56bb4db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8b1e0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8b1e0a-86db66d579 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b1e0a: serviceaccount "payload-processing-e2e-ipp-a-8b1e0a" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b1e0a-86db66d579

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8b1e0a-86db66d579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b1e0a: serviceaccount "payload-processing-e2e-ipp-a-8b1e0a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8b1e0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b1e0a-86db66d579

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-96567a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-96567a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d66ae6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d66ae6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp
(x5)

openshift-ingress

kubelet

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-mr2rp

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-cbl2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-dmltg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a28730-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-96567a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a28730-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-96567a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-hn9m7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d66ae6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d66ae6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-59d784d8c-n7rfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-7c7fc89749-mpmmg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7a54db-6695679ff9-l6kwf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7a54db-5bd6ff8dd4-b9w5x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-j22vj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-9847b887-f7m7g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-b8d48f6b7-w22gk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-7a54db-openshift-default-68666f54f-9tggn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-fe2565

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-fe2565

openshift-ingress

multus

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-fe2565-openshift-default-896f55d6f

SuccessfulCreate

Created pod: e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

openshift-ingress

deployment-controller

e2e-praxis-b-fe2565-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-fe2565-openshift-default-896f55d6f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fe2565: serviceaccount "payload-processing-e2e-praxis-b-fe2565" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fe2565: serviceaccount "payload-processing-e2e-praxis-b-fe2565" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-fe2565

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-fe2565

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-fe2565-76d8bdbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fe2565-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fe2565-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a28730

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a28730-797866c57d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a28730

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a28730-797866c57d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a28730-797866c57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a28730: serviceaccount "payload-processing-e2e-ipp-b-a28730" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a28730: serviceaccount "payload-processing-e2e-ipp-b-a28730" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a28730-797866c57d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b1e0a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b1e0a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-96567a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-96567a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-96567a-6996946fdc from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-96567a: serviceaccount "payload-processing-e2e-ipp-b-96567a" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-96567a: serviceaccount "payload-processing-e2e-ipp-b-96567a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b1e0a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8b1e0a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-577ea8-6969d4d4cf-kqr2b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-577ea8-64c56bb4db-gf6tk

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-955887

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-955887

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-86db66d579-k9lpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-569f4b4d6c-lgn2w

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-955887-openshift-default-5df5db6df

SuccessfulCreate

Created pod: e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

openshift-ingress

deployment-controller

e2e-ipp-b-955887-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-955887-openshift-default-5df5db6df from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-577ea8-openshift-default-654dd86f59-s688s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-955887

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-955887-85b4df78c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-955887-85b4df78c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-955887-85b4df78c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-955887: serviceaccount "payload-processing-e2e-ipp-b-955887" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-955887-85b4df78c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-955887

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-955887-56d4599cf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-955887: serviceaccount "payload-processing-e2e-ipp-b-955887" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-955887-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-955887-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused

openshift-ingress

multus

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-086575-openshift-default-6cc587cbd9

SuccessfulCreate

Created pod: e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

openshift-ingress

deployment-controller

e2e-praxis-a-086575-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-086575-openshift-default-6cc587cbd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-086575

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-086575

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fe2565-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fe2565-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-086575

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-086575

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-086575-6f88b54769 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-086575: serviceaccount "payload-processing-e2e-praxis-a-086575" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-086575-6f88b54769

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-086575-6f88b54769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-086575: serviceaccount "payload-processing-e2e-praxis-a-086575" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-086575-6f88b54769

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8b1e0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8b1e0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8b1e0a-74675b7d96 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b1e0a: serviceaccount "payload-processing-e2e-ipp-a-8b1e0a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8b1e0a: serviceaccount "payload-processing-e2e-ipp-a-8b1e0a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-69a1d2-fb9b8d85b-2tszp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-69a1d2-594bb58c47-wvs7k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-69a1d2-openshift-default-987788949-sshrh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a28730-64694c8c9f-69dbh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a28730-797866c57d-7vgzg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-j249g

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 10 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-j249g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-lzkmk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lzkmk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-r6nlx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a28730-openshift-default-5dd7449995-8zvk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fjr78

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-praxis-a-cce50a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-cce50a-openshift-default-5666c7db6f from 0 to 1

openshift-ingress

multus

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-cce50a-openshift-default-5666c7db6f

SuccessfulCreate

Created pod: e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-cce50a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-cce50a

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d66ae6-6c9cbfb979-ltrg2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d66ae6-754d795479-px7fl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

ProbeError

Readiness probe error: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

Unhealthy

Readiness probe failed: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-cce50a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-cce50a-7c74b44fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-cce50a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-cce50a-7c74b44fc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-cce50a-7c74b44fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-cce50a: serviceaccount "payload-processing-e2e-praxis-a-cce50a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-cce50a-7c74b44fc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-cce50a: serviceaccount "payload-processing-e2e-praxis-a-cce50a" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk

openshift-ingress

multus

payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-d66ae6-openshift-default-675d86cfd5-8xfpm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-955887-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-955887-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fe2565-6f586c5cdc-wlf24

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fe2565-76d8bdbb7-bhkvs

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2edb49-78d986d578-bxdkj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2edb49-65d8969d87-knsxs

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-q5v68

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-q5v68

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-msm7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-85b4df78c9-wjvgr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-5q9b9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-56d4599cf5-ws6cm

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w4-d2a3e0-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-d2a3e0-openshift-default-c6495b579 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d2a3e0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-x9kqk

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-086575-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-086575-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w4-d2a3e0-openshift-default-c6495b579

SuccessfulDelete

Deleted pod: e2e-worker-w4-d2a3e0-openshift-default-c6495b579-vf6jw

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-zn9bc

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9

SuccessfulDelete

Deleted pod: e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-76vf2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-1c3eef-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-1c3eef-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9 from 2 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-37a390

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-37a390

openshift-ingress

deployment-controller

e2e-praxis-b-37a390-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-37a390-openshift-default-cb9fdf5f7 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7

SuccessfulCreate

Created pod: e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-086575-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-086575-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-37a390

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-37a390-59bfbfcf5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-37a390-59bfbfcf5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-37a390-59bfbfcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-37a390: serviceaccount "payload-processing-e2e-praxis-b-37a390" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-37a390

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-37a390: serviceaccount "payload-processing-e2e-praxis-b-37a390" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-37a390-59bfbfcf5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-955887

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-955887-6b66898f6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-955887

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-955887-b8d7c5cb4 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-955887: serviceaccount "payload-processing-e2e-ipp-b-955887" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-955887-b8d7c5cb4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-955887-b8d7c5cb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-955887: serviceaccount "payload-processing-e2e-ipp-b-955887" not found

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-fe2565-openshift-default-896f55d6f-qmnxp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-955887-b8d7c5cb4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cce50a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cce50a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-2edb49-openshift-default-7fdb57977f-xzlb5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

ProbeError

Startup probe error: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

Unhealthy

Startup probe failed: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-96567a-6996946fdc-cwt4g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-96567a-6f4c8bf5c6-btdxh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-96567a-openshift-default-564c67b55c-79r8h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-a853fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a853fe-openshift-default-6c854c8bb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-a853fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-a853fe

openshift-ingress

replicaset-controller

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5

SuccessfulCreate

Created pod: e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

openshift-ingress

multus

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8b1e0a-74675b7d96-jzfqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8b1e0a-5bd7446855-wgrbx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c

SuccessfulCreate

Created pod: e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

openshift-ingress

deployment-controller

e2e-praxis-b-5b1e39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-5b1e39-openshift-default-5c985bc7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-5b1e39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-5b1e39

openshift-ingress

multus

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cce50a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cce50a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

Created

Container created

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-8b1e0a-openshift-default-5f759d897-xj4kl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a853fe: serviceaccount "payload-processing-e2e-praxis-a-a853fe" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-a853fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a853fe-86b8f5c447

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-a853fe-86b8f5c447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a853fe: serviceaccount "payload-processing-e2e-praxis-a-a853fe" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-a853fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-a853fe-86b8f5c447 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a853fe-86b8f5c447

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-5b1e39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-5b1e39-6557cdbb99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5b1e39: serviceaccount "payload-processing-e2e-praxis-b-5b1e39" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5b1e39-649496847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-5b1e39-649496847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5b1e39: serviceaccount "payload-processing-e2e-praxis-b-5b1e39" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5b1e39-649496847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb
(x2)

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-5b1e39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-5b1e39-649496847 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-37a390-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-37a390-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

ProbeError

Startup probe error: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

Unhealthy

Startup probe failed: Get "http://10.134.0.156:15021/healthz/ready": dial tcp 10.134.0.156:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

ProbeError

Startup probe error: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

Unhealthy

Startup probe failed: Get "http://10.133.0.161:15021/healthz/ready": dial tcp 10.133.0.161:15021: connect: connection refused
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 3 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

Started

Container started

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-37a390-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-37a390-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-955887-b8d7c5cb4-gqg5l

Unhealthy

Readiness probe failed: dial tcp 10.134.0.161:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-955887-6b66898f6c-5r4hf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-pqpw6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-955887-openshift-default-5df5db6df-tb8g4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5b1e39-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5b1e39-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

ProbeError

Startup probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

Unhealthy

Startup probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a853fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

ProbeError

Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

Unhealthy

Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a853fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-42e8a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-42e8a1

openshift-ingress

replicaset-controller

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7

SuccessfulCreate

Created pod: e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

openshift-ingress

deployment-controller

e2e-praxis-a-42e8a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-42e8a1-openshift-default-7987cb45c7 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-42e8a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-42e8a1: serviceaccount "payload-processing-e2e-praxis-a-42e8a1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-42e8a1: serviceaccount "payload-processing-e2e-praxis-a-42e8a1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-42e8a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

openshift-ingress

multus

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Started

Container started

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Created

Container created

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": dial tcp 10.133.0.168:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Unhealthy

Startup probe failed: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

ProbeError

Startup probe error: Get "http://10.133.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5b1e39-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5b1e39-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a853fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a853fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b563fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b563fd

openshift-ingress

multus

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-b563fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b563fd-openshift-default-7797f8c88f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-b563fd-openshift-default-7797f8c88f

SuccessfulCreate

Created pod: e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b563fd-669b78595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b563fd-669b78595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b563fd-669b78595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b563fd: serviceaccount "payload-processing-e2e-praxis-b-b563fd" not found
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 4 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b563fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b563fd-669b78595 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b563fd-9877fb8f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b563fd-9877fb8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b563fd: serviceaccount "payload-processing-e2e-praxis-b-b563fd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b563fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b563fd-9877fb8f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b563fd-9877fb8f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf

openshift-ingress

multus

payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulCreate

Created pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-c8sl7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cce50a-d7946cc79-g5nnk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cce50a-7c74b44fc-wqs8d

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b563fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b563fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-cce50a-openshift-default-5666c7db6f-8qv2v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5b1e39-6557cdbb99-zps2s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5b1e39-649496847-gfkmb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-42e8a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-42e8a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-5b1e39-openshift-default-5c985bc7c-gsvx8

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-42e8a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-42e8a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c

SuccessfulCreate

Created pod: e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

openshift-ingress

deployment-controller

e2e-praxis-b-3bbd9b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-3bbd9b-openshift-default-65b67b949c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-3bbd9b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-3bbd9b

openshift-ingress

multus

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3bbd9b: serviceaccount "payload-processing-e2e-praxis-b-3bbd9b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-3bbd9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3bbd9b: serviceaccount "payload-processing-e2e-praxis-b-3bbd9b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-3bbd9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b563fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b563fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-086575-6c7cc78fcf-lxr8k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-086575-6f88b54769-9rpxj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a853fe-9ffb88c9f-wnthx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a853fe-86b8f5c447-n6g97

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7

SuccessfulCreate

Created pod: e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

openshift-ingress

deployment-controller

e2e-shared-a-w2-a0116e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-a0116e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-a0116e

openshift-ingress

multus

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-a853fe-openshift-default-6c854c8bb5-6rpbc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-e90906

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-e90906

openshift-ingress

replicaset-controller

e2e-shared-a-w0-e90906-openshift-default-57cd56f465

SuccessfulCreate

Created pod: e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

openshift-ingress

deployment-controller

e2e-shared-a-w0-e90906-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-e90906-openshift-default-57cd56f465 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

ProbeError

Readiness probe error: Get "http://10.133.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Unhealthy

Readiness probe failed: Get "http://10.133.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-a0116e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a0116e: serviceaccount "payload-processing-e2e-shared-a-w2-a0116e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-a0116e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a0116e: serviceaccount "payload-processing-e2e-shared-a-w2-a0116e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b563fd-9877fb8f-4n8nf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b563fd-669b78595-tpnvm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

Started

Container started

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-e90906

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-e90906-df86d8647 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3bbd9b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3bbd9b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-e90906-df86d8647

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-e90906: serviceaccount "payload-processing-e2e-shared-a-w0-e90906" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-e90906

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-e90906-df86d8647

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-e90906-df86d8647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-e90906: serviceaccount "payload-processing-e2e-shared-a-w0-e90906" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a0116e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a0116e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 3 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4bfdv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulCreate

Created pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

ProbeError

Startup probe error: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

Unhealthy

Startup probe failed: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3bbd9b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3bbd9b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-b563fd-openshift-default-7797f8c88f-m5fgc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-086575-openshift-default-6cc587cbd9-nhg8l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-42e8a1-b87d5f9dc-jq2qz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-42e8a1-67dbdc88b9-f55lt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-37a390-795bc4bfd7-x79x8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-37a390-59bfbfcf5-lh2w5

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457

SuccessfulCreate

Created pod: e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-b4deef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-b4deef

openshift-ingress

deployment-controller

e2e-shared-a-w1-b4deef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-42e8a1-openshift-default-7987cb45c7-zw97d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b4deef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b4deef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

ProbeError

Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-b4deef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

Unhealthy

Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-b4deef: serviceaccount "payload-processing-e2e-shared-a-w1-b4deef" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-b4deef: serviceaccount "payload-processing-e2e-shared-a-w1-b4deef" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-b4deef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-b4deef-8655ff8547 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3bbd9b-69c69f6b49-z4kff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3bbd9b-55df5d64c-9bpr5

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e90906-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e90906-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985

SuccessfulCreate

Created pod: e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-6c788d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-6c788d

openshift-ingress

deployment-controller

e2e-shared-b-w2-6c788d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e90906-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-e90906-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w0-b1eb3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7

SuccessfulCreate

Created pod: e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-6c788d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-6c788d-d46484bf9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6c788d: serviceaccount "payload-processing-e2e-shared-b-w2-6c788d" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-b1eb3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-b1eb3f

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-6c788d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6c788d: serviceaccount "payload-processing-e2e-shared-b-w2-6c788d" not found

openshift-ingress

multus

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq

AddedInterface

Add eth0 [10.134.0.193/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a0116e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a0116e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-b1eb3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-b1eb3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-b1eb3f: serviceaccount "payload-processing-e2e-shared-b-w0-b1eb3f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-b1eb3f: serviceaccount "payload-processing-e2e-shared-b-w0-b1eb3f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-37a390-openshift-default-cb9fdf5f7-wl98l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-6c788d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-6c788d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-3bbd9b-openshift-default-65b67b949c-htr44

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7

SuccessfulCreate

Created pod: e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

openshift-ingress

deployment-controller

e2e-shared-a-w3-89cf28-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-89cf28

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-89cf28

openshift-ingress

multus

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-89cf28

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-89cf28: serviceaccount "payload-processing-e2e-shared-a-w3-89cf28" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-89cf28: serviceaccount "payload-processing-e2e-shared-a-w3-89cf28" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-89cf28

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

Started

Container started

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

Created

Container created

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b4deef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-b4deef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

Unhealthy

Startup probe failed: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

Unhealthy

Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

ProbeError

Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

ProbeError

Startup probe error: Get "http://10.133.0.201:15021/healthz/ready": dial tcp 10.133.0.201:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Unhealthy

Readiness probe failed: Get "http://10.132.0.153:15021/healthz/ready": read tcp 10.132.0.2:42580->10.132.0.153:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

ProbeError

Readiness probe error: Get "http://10.132.0.153:15021/healthz/ready": read tcp 10.132.0.2:42580->10.132.0.153:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Unhealthy

Startup probe failed: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

ProbeError

Startup probe error: Get "http://10.132.0.153:15021/healthz/ready": dial tcp 10.132.0.153:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-9f7654

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-9f7654

openshift-ingress

deployment-controller

e2e-shared-b-w1-9f7654-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-9f7654-openshift-default-697764d49 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w1-9f7654-openshift-default-697764d49

SuccessfulCreate

Created pod: e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-6c788d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-6c788d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-9f7654

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-9f7654: serviceaccount "payload-processing-e2e-shared-b-w1-9f7654" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-9f7654-694985699f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-9f7654-694985699f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-9f7654: serviceaccount "payload-processing-e2e-shared-b-w1-9f7654" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-9f7654

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-9f7654-694985699f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-9f7654-694985699f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

Unhealthy

Startup probe failed: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

ProbeError

Startup probe error: Get "http://10.132.0.154:15021/healthz/ready": dial tcp 10.132.0.154:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b1eb3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b1eb3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-explicit-9651e9-openshift-default-569445c5c

SuccessfulCreate

Created pod: e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

openshift-ingress

deployment-controller

e2e-explicit-9651e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-9651e9-openshift-default-569445c5c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-9651e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-9651e9

openshift-ingress

multus

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-9f7654-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-9f7654-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-9651e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-9651e9-7974fc89c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-9651e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-9651e9-65db7c4bf5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-9651e9: serviceaccount "payload-processing-e2e-explicit-9651e9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-9651e9-65db7c4bf5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-9651e9-65db7c4bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-9651e9: serviceaccount "payload-processing-e2e-explicit-9651e9" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

Unhealthy

Startup probe failed: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-9651e9-65db7c4bf5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

ProbeError

Startup probe error: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b1eb3f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-b1eb3f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-89cf28-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-89cf28-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

ProbeError

Readiness probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

Unhealthy

Readiness probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985

SuccessfulCreate

Created pod: e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

openshift-ingress

deployment-controller

e2e-shared-b-w3-0e450a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-0e450a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-0e450a

openshift-ingress

multus

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

Unhealthy

Startup probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

ProbeError

Startup probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0e450a: serviceaccount "payload-processing-e2e-shared-b-w3-0e450a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-0e450a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0e450a: serviceaccount "payload-processing-e2e-shared-b-w3-0e450a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-0e450a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-t8wsb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-2mq4h

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-lh9ls

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-nfwzq
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-9f7654-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-9f7654-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

(combined from similar events): New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-cv6k9
(x2)

openshift-ingress

kubelet

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

Unhealthy

Startup probe failed: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9651e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

ProbeError

Startup probe error: Get "http://10.134.0.203:15021/healthz/ready": dial tcp 10.134.0.203:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9651e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

ProbeError

Startup probe error: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

Unhealthy

Startup probe failed: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9651e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-9651e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-0e450a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-0e450a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-wrhzq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-694db55c87-bxr9x

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 2 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-bxr9x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-q5rsp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-gx4g7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-pd2ff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-9651e9-7974fc89c9-pt9xf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-9651e9-65db7c4bf5-nk44t

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-c4knx

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 3 to 2

openshift-ingress

kubelet

e2e-explicit-9651e9-openshift-default-569445c5c-2gjbv

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-6eae99

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6eae99

openshift-ingress

deployment-controller

e2e-noten-6eae99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6eae99-openshift-default-847d7f8fcf from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-6eae99-openshift-default-847d7f8fcf

SuccessfulCreate

Created pod: e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p

openshift-ingress

kubelet

e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p

Created

Container created

openshift-ingress

multus

e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-6eae99-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-6eae99-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c

SuccessfulDelete

Deleted pod: e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

Unhealthy

Readiness probe failed: Get "http://10.132.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-z6dwn

ProbeError

Readiness probe error: Get "http://10.132.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-6eae99-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-6eae99-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-noten-6eae99-openshift-default-847d7f8fcf-t7f8p

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

deployment-controller

e2e-worker-w0-b8717e-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-b8717e-openshift-default-5b5cc794f from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-b8717e-openshift-default-5b5cc794f

SuccessfulDelete

Deleted pod: e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-b8717e-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulDelete

Deleted pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-cbhnx

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-d8s68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 3 to 2

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-bpgb5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-7370-9cf96a

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7370-9cf96a

Created

Container created

opendatahub

kubelet

test-curl-7370-9cf96a

Started

Container started

opendatahub

kubelet

test-curl-7370-9cf96a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7376-3a9827

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7370-a60adf

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7376-3a9827

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

opendatahub

multus

test-curl-7370-a60adf

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7376-3a9827

Created

Container created

opendatahub

kubelet

test-curl-7376-3a9827

Started

Container started

opendatahub

kubelet

test-curl-7370-9cf96a

Killing

Stopping container test-curl-7370-9cf96a

opendatahub

kubelet

test-curl-7370-a60adf

Created

Container created

opendatahub

kubelet

test-curl-7370-a60adf

Started

Container started

opendatahub

kubelet

test-curl-7376-3a9827

Killing

Stopping container test-curl-7376-3a9827

opendatahub

kubelet

test-curl-7370-a60adf

Killing

Stopping container test-curl-7370-a60adf

openshift-ingress

replicaset-controller

e2e-extmod-a-a6900c-openshift-default-59799ddcb9

SuccessfulCreate

Created pod: e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

openshift-ingress

deployment-controller

e2e-extmod-a-a6900c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a6900c-openshift-default-59799ddcb9 from 0 to 1

opendatahub

multus

test-curl-7370-72f4fb

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7370-72f4fb

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7370-72f4fb

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a6900c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a6900c

opendatahub

kubelet

test-curl-7370-72f4fb

Started

Container started

openshift-ingress

multus

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7370-c9b104

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7370-c9b104

AddedInterface

Add eth0 [10.133.0.216/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7370-72f4fb

Killing

Stopping container test-curl-7370-72f4fb

opendatahub

kubelet

test-curl-7370-c9b104

Started

Container started

opendatahub

kubelet

test-curl-7370-c9b104

Created

Container created

opendatahub

kubelet

test-curl-7370-628894

Started

Container started

opendatahub

kubelet

test-curl-7370-c9b104

Killing

Stopping container test-curl-7370-c9b104

opendatahub

kubelet

test-curl-7370-628894

Created

Container created

opendatahub

kubelet

test-curl-7370-628894

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7370-628894

AddedInterface

Add eth0 [10.133.0.218/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7370-628894

Killing

Stopping container test-curl-7370-628894

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a6900c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a6900c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a6900c-7686bc5445 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a6900c: serviceaccount "payload-processing-e2e-extmod-a-a6900c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a6900c-7686bc5445

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a6900c-7686bc5445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a6900c: serviceaccount "payload-processing-e2e-extmod-a-a6900c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a6900c-7686bc5445

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9

SuccessfulCreate

Created pod: e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

openshift-ingress

deployment-controller

e2e-extmod-a-20ccef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-20ccef-openshift-default-67bf8f7b9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-20ccef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-20ccef

openshift-ingress

multus

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-20ccef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-20ccef-97857d599 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-20ccef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-20ccef-7f969c7869 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-20ccef-7f969c7869

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-20ccef-7f969c7869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-20ccef: serviceaccount "payload-processing-e2e-extmod-a-20ccef" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-20ccef-97857d599

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-20ccef-97857d599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-20ccef: serviceaccount "payload-processing-e2e-extmod-a-20ccef" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-20ccef-97857d599

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-20ccef-7f969c7869

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx

openshift-ingress

multus

payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-90e0d5-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

deployment-controller

e2e-worker-w2-90e0d5-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-9sczj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-extmod-a-15e0f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-15e0f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-15e0f6

openshift-ingress

replicaset-controller

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9

SuccessfulCreate

Created pod: e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

openshift-ingress

multus

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-15e0f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-15e0f6-6f944c69fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-15e0f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c

AddedInterface

Add eth0 [10.133.0.224/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-15e0f6: serviceaccount "payload-processing-e2e-extmod-a-15e0f6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-15e0f6: serviceaccount "payload-processing-e2e-extmod-a-15e0f6" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-15e0f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-15e0f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-55edb1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-55edb1

openshift-ingress

deployment-controller

e2e-extmod-a-55edb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-55edb1-openshift-default-66bb67b689 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-55edb1-openshift-default-66bb67b689

SuccessfulCreate

Created pod: e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

openshift-ingress

multus

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

ProbeError

Readiness probe error: Get "http://10.132.0.161:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Unhealthy

Readiness probe failed: Get "http://10.132.0.161:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20ccef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20ccef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-55edb1: serviceaccount "payload-processing-e2e-extmod-a-55edb1" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-55edb1-86677cc887

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-55edb1-86677cc887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-55edb1: serviceaccount "payload-processing-e2e-extmod-a-55edb1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-55edb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-55edb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-55edb1-86677cc887 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9

AddedInterface

Add eth0 [10.133.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-55edb1-86677cc887

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9

openshift-ingress

multus

payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f

AddedInterface

Add eth0 [10.134.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a6900c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a6900c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7373-6e7f54

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7373-6e7f54

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7373-6e7f54

Started

Container started

opendatahub

kubelet

test-curl-7373-6e7f54

Created

Container created

opendatahub

kubelet

test-curl-7373-6e7f54

Killing

Stopping container test-curl-7373-6e7f54

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a6900c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a6900c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20ccef-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-20ccef-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-69058c-openshift-default-848df6554f

SuccessfulCreate

Created pod: e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

openshift-ingress

deployment-controller

e2e-extmod-b-69058c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-69058c-openshift-default-848df6554f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-69058c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-69058c

openshift-ingress

multus

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-69058c: serviceaccount "payload-processing-e2e-extmod-b-69058c" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-69058c-7b4b756787

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-69058c-7b4b756787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-69058c: serviceaccount "payload-processing-e2e-extmod-b-69058c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-69058c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-69058c-7b4b756787

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-69058c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-69058c-7b4b756787 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

ProbeError

Startup probe error: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

Unhealthy

Startup probe failed: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-15e0f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-15e0f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-32af64

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-32af64

openshift-ingress

deployment-controller

e2e-extmod-b-32af64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-32af64-openshift-default-8d46c9697 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-32af64-openshift-default-8d46c9697

SuccessfulCreate

Created pod: e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

openshift-ingress

multus

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-32af64-56bd55d965

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-32af64-56bd55d965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-32af64: serviceaccount "payload-processing-e2e-extmod-b-32af64" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-32af64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-32af64-56bd55d965 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-32af64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-32af64: serviceaccount "payload-processing-e2e-extmod-b-32af64" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-32af64-56bd55d965

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4

AddedInterface

Add eth0 [10.133.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-autores-9e18b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-9e18b5

openshift-ingress

multus

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-9e18b5-openshift-default-54dd5bf5cf

SuccessfulCreate

Created pod: e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

openshift-ingress

deployment-controller

e2e-autores-9e18b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-9e18b5-openshift-default-54dd5bf5cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-9e18b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-9e18b5-7dfc749c75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9e18b5-6875cb8497

FailedCreate

Error creating: pods "payload-processing-e2e-autores-9e18b5-6875cb8497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9e18b5: serviceaccount "payload-processing-e2e-autores-9e18b5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-9e18b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-9e18b5-6875cb8497 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9e18b5-6875cb8497

SuccessfulCreate

Created pod: payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9e18b5: serviceaccount "payload-processing-e2e-autores-9e18b5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98

AddedInterface

Add eth0 [10.133.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg

AddedInterface

Add eth0 [10.134.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-b1b1eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-b1b1eb
(x2)

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585

SuccessfulCreate

Created pod: e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

openshift-ingress

deployment-controller

e2e-extmod-b-b1b1eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b1b1eb-openshift-default-75fb95c585 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

Unhealthy

Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

ProbeError

Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-b1b1eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-b1b1eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b1b1eb: serviceaccount "payload-processing-e2e-extmod-b-b1b1eb" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9

AddedInterface

Add eth0 [10.133.0.245/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd

AddedInterface

Add eth0 [10.133.0.244/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b1b1eb: serviceaccount "payload-processing-e2e-extmod-b-b1b1eb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-55edb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-55edb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-55edb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-55edb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69058c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69058c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

ProbeError

Startup probe error: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

Unhealthy

Startup probe failed: Get "http://10.132.0.169:15021/healthz/ready": dial tcp 10.132.0.169:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-55edb1-768b8c66c5-8q6g9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-55edb1-86677cc887-fmc2f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Unhealthy

Readiness probe failed: Get "http://10.134.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

ProbeError

Readiness probe error: Get "http://10.134.0.224:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

ProbeError

Startup probe error: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Unhealthy

Startup probe failed: Get "http://10.134.0.224:15021/healthz/ready": dial tcp 10.134.0.224:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-32af64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-32af64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69058c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-69058c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9e18b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9e18b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-32af64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

ProbeError

Startup probe error: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

Unhealthy

Startup probe failed: Get "http://10.132.0.170:15021/healthz/ready": dial tcp 10.132.0.170:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-32af64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a6900c-7686bc5445-fbfd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a6900c-688d86d78c-c26br

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9e18b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-9e18b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b1b1eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b1b1eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-20ccef-97857d599-xlm6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-20ccef-7f969c7869-s77bx

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

ProbeError

Startup probe error: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

Unhealthy

Startup probe failed: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e18b5-7dfc749c75-pr5xg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-9e18b5-6875cb8497-7tp98

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b1b1eb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b1b1eb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-55edb1-openshift-default-66bb67b689-sshfb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-15e0f6-7c65f9b455-6955c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-15e0f6-6f944c69fc-5927g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-6924e5-openshift-default-648b667bb9

SuccessfulCreate

Created pod: e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

openshift-ingress

deployment-controller

e2e-extmod-a-6924e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6924e5-openshift-default-648b667bb9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6924e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6924e5

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

AddedInterface

Add eth0 [10.133.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-9e18b5-openshift-default-54dd5bf5cf-f84tl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-a6900c-openshift-default-59799ddcb9-2hcb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-15e0f6-openshift-default-6fbd5577b9-xztj8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-69058c-6f59c784c9-wjgfv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-b4deef-8655ff8547-rbtbl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-69058c-7b4b756787-tw68s

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-b4deef-7697f6b559-jqh8h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b1b1eb-5cbf6cf4bc-glsx9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b1b1eb-7f6b9c9d9f-7zxkd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-20ccef-openshift-default-67bf8f7b9-lb5sf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6924e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6924e5-7577ccfff7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6924e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6924e5: serviceaccount "payload-processing-e2e-extmod-a-6924e5" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6924e5-7577ccfff7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6924e5-7577ccfff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6924e5: serviceaccount "payload-processing-e2e-extmod-a-6924e5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s

AddedInterface

Add eth0 [10.134.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6924e5-7577ccfff7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-32af64-56bd55d965-49qp4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-32af64-65f8bcc879-vdpvm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-32af64-openshift-default-8d46c9697-cs2vk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-b4deef-openshift-default-6d68f9f457-v8vrp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-b1b1eb-openshift-default-75fb95c585-cf7s4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-9f7654-openshift-default-697764d49-hmjxb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a0116e-76544d48bc-5czsx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a0116e-5475dd76fc-hs2vl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-69058c-openshift-default-848df6554f-pcwck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-9f7654-5b8fc8fc7f-b2dz9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-9f7654-694985699f-f7g87

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d2a3e0-6ffb8c767f-792tc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d2a3e0-5c54bc4fcc-9n25n

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-1c3eef-68464d9f59-l9kkn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-1c3eef-579584b4c9-g29mw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-e90906-647568c97f-mpn6q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-e90906-df86d8647-ws84t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

Unhealthy

Startup probe failed: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

ProbeError

Startup probe error: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6924e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w2-a0116e-openshift-default-d69c5cbd7-zd8mg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6924e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-e90906-openshift-default-57cd56f465-6fcf4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

AddedInterface

Add eth0 [10.134.0.233/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-3faf84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-3faf84-openshift-default-58b4df664f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-3faf84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-3faf84

openshift-ingress

replicaset-controller

e2e-extmod-b-3faf84-openshift-default-58b4df664f

SuccessfulCreate

Created pod: e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-b1eb3f-openshift-default-699765bbd7-hp9ms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6c788d-5cb67c5479-fb8gq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6c788d-d46484bf9-wp8nm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6924e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6924e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-3faf84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3faf84: serviceaccount "payload-processing-e2e-extmod-b-3faf84" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-3faf84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-3faf84-7bb789f6fc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3faf84: serviceaccount "payload-processing-e2e-extmod-b-3faf84" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r

openshift-ingress

multus

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-b1eb3f-5996948b67-fx5zq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-b1eb3f-58cbfc6c85-f5kb8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-b8717e-66555bd5dc-dbp72

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-b8717e-545855f4c9-d792w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-1c3eef-openshift-default-7c9cd69cb9-whbjh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-d2a3e0-openshift-default-c6495b579-28c2g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-6c788d-openshift-default-65f5f4d985-lh655

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Unhealthy

Readiness probe failed: Get "http://10.134.0.233:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

ProbeError

Readiness probe error: Get "http://10.134.0.233:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Unhealthy

Startup probe failed: Get "http://10.134.0.233:15021/healthz/ready": dial tcp 10.134.0.233:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

ProbeError

Startup probe error: Get "http://10.134.0.233:15021/healthz/ready": dial tcp 10.134.0.233:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-90e0d5-76ddd5dc65-vbhnn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-90e0d5-79f87f5ff9-9jnkq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-b8717e-openshift-default-5b5cc794f-fxs72

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3faf84-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3faf84-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6924e5-559df96b8c-mndrr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6924e5-7577ccfff7-qzt9s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-90e0d5-openshift-default-6cbd58cf8c-zxc28

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-6924e5-openshift-default-648b667bb9-q95km

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3faf84-7bb789f6fc-bhk6r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3faf84-84b85d9c6c-xrj6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-3faf84-openshift-default-58b4df664f-d4dbh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-89cf28-openshift-default-6f6c4ff5c7-d2lbn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-89cf28-f6847849f-hg28r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-89cf28-66bc8f7c5f-9f6g6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e450a-6d8db5c787-4pvjt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-0e450a-openshift-default-dd9f4d985-xd9dk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e450a-76d6769cc9-8q5g4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-e90e35-66b887d98c-tmqg5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-e90e35-8647584c55-b2zbt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-e90e35-openshift-default-7846d9f897

SuccessfulCreate

Created pod: e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

openshift-ingress

multus

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

AddedInterface

Add eth0 [10.133.1.22/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-e90e35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-e90e35-openshift-default-7846d9f897 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-e90e35-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w3-e90e35-openshift-default-dockercfg-4j6lz); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-ct4w2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-e90e35-openshift-default-7846d9f897-l8nlv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503