Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b to ip-10-0-128-161.us-east-2.compute.internal

opendatahub

test-curl-7603-0f8dd3

Scheduled

Successfully assigned opendatahub/test-curl-7603-0f8dd3 to ip-10-0-128-161.us-east-2.compute.internal

opendatahub

test-curl-7609-4453f0

Scheduled

Successfully assigned opendatahub/test-curl-7609-4453f0 to ip-10-0-128-161.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-btqgb

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-btqgb to ip-10-0-130-52.us-east-2.compute.internal

opendatahub

test-curl-7609-626c35

Scheduled

Successfully assigned opendatahub/test-curl-7609-626c35 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

router-default-7dc99f8759-pzknq

Scheduled

Successfully assigned openshift-ingress/router-default-7dc99f8759-pzknq to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

router-default-7dc99f8759-pzknq

FailedScheduling

no nodes available to schedule pods

opendatahub

model-serving-api-75bd89fdfc-htl5n

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-htl5n to ip-10-0-130-52.us-east-2.compute.internal

opendatahub

test-curl-7609-703e17

Scheduled

Successfully assigned opendatahub/test-curl-7609-703e17 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

router-default-7dc99f8759-pzknq

FailedScheduling

no nodes available to schedule pods

opendatahub

test-curl-7609-72666a

Scheduled

Successfully assigned opendatahub/test-curl-7609-72666a to ip-10-0-128-161.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-4dv9m

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-4dv9m to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6 to ip-10-0-135-178.us-east-2.compute.internal

opendatahub

test-curl-7609-8b05dd

Scheduled

Successfully assigned opendatahub/test-curl-7609-8b05dd to ip-10-0-128-161.us-east-2.compute.internal

opendatahub

test-curl-7609-b45643

Scheduled

Successfully assigned opendatahub/test-curl-7609-b45643 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-64cbf78866-9kpj2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-64cbf78866-9kpj2 to ip-10-0-130-52.us-east-2.compute.internal

opendatahub

test-curl-7615-065799

Scheduled

Successfully assigned opendatahub/test-curl-7615-065799 to ip-10-0-128-161.us-east-2.compute.internal

opendatahub

maas-controller-f5d6dd878-twxgq

Scheduled

Successfully assigned opendatahub/maas-controller-f5d6dd878-twxgq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-64cbf78866-vhxkm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-64cbf78866-vhxkm to ip-10-0-128-161.us-east-2.compute.internal

opendatahub

test-curl-7615-4398ef

Scheduled

Successfully assigned opendatahub/test-curl-7615-4398ef to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw to ip-10-0-128-161.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-zpnjg

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-zpnjg to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-319188-59f459b575-r26vz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-319188-59f459b575-r26vz to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4 to ip-10-0-130-52.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-27ckg

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-27ckg to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-435414-6f9b5df87-kwdfk to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-345bc4-7555945897-88pml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-345bc4-7555945897-88pml to ip-10-0-128-161.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-2pqvr

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-2pqvr to ip-10-0-130-52.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-7jcqr

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-7jcqr to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks to ip-10-0-128-161.us-east-2.compute.internal

kuadrant-system

authorino-6dd76875b5-8p6dg

Scheduled

Successfully assigned kuadrant-system/authorino-6dd76875b5-8p6dg to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz to ip-10-0-128-161.us-east-2.compute.internal

kuadrant-system

authorino-6f767f5f8-dnjx6

Scheduled

Successfully assigned kuadrant-system/authorino-6f767f5f8-dnjx6 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974 to ip-10-0-135-178.us-east-2.compute.internal

kuadrant-system

authorino-798dd5cc85-s2vpq

Scheduled

Successfully assigned kuadrant-system/authorino-798dd5cc85-s2vpq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw to ip-10-0-135-178.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-dtgm8

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-dtgm8 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw to ip-10-0-135-178.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-rf52l

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-rf52l to ip-10-0-130-52.us-east-2.compute.internal

opendatahub

maas-controller-67dcc64f86-rdbqv

Scheduled

Successfully assigned opendatahub/maas-controller-67dcc64f86-rdbqv to ip-10-0-130-52.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-597bf9dc6d-mxkdz to ip-10-0-135-178.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-jvp24

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-jvp24 to ip-10-0-128-161.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-597bf9dc6d-pz44x to ip-10-0-128-161.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-qnpf4

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-qnpf4 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-b16c21be-c777df947-zkld5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b16c21be-c777df947-zkld5 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-fztgr

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-fztgr to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k to ip-10-0-135-178.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-dpr68

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-dpr68 to ip-10-0-135-178.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-597bf9dc6d-qbdqh to ip-10-0-130-52.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-jclms

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-jclms to ip-10-0-135-178.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-chpzx

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-chpzx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-57dc67465-62gx5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-57dc67465-62gx5 to ip-10-0-135-178.us-east-2.compute.internal

opendatahub

ai-gateway-controller-b47bd7b99-gx47b

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-b47bd7b99-gx47b to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-2h8ll

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-2h8ll to ip-10-0-135-178.us-east-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-m2n56

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-m2n56 to ip-10-0-130-52.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-57fd4644b5-9vmrb

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-57fd4644b5-9vmrb to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng to ip-10-0-130-52.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-cs5q5

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-cs5q5 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-6nj94

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-6nj94 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6 to ip-10-0-135-178.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7rkvg

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7rkvg to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b to ip-10-0-128-161.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-tbbnz

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-tbbnz to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-7pzkt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-7pzkt to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg to ip-10-0-135-178.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-jpzw8

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-jpzw8 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw to ip-10-0-130-52.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-qwdhc

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-qwdhc to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp to ip-10-0-128-161.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dwfh7

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-dwfh7 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-9cqch

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-9cqch to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-b8h86

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-b8h86 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755 to ip-10-0-130-52.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw to ip-10-0-130-52.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-hl2cc

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-hl2cc to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c to ip-10-0-130-52.us-east-2.compute.internal

cert-manager

cert-manager-597b95cb84-tpc9x

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-tpc9x to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g to ip-10-0-128-161.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-vgkmj

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-vgkmj to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h to ip-10-0-130-52.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-x27k5

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-x27k5 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h to ip-10-0-130-52.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx to ip-10-0-128-161.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-gtxbn

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-gtxbn to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx to ip-10-0-130-52.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-d257f

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d257f to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm to ip-10-0-128-161.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

Scheduled

Successfully assigned openshift-ingress/e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-435414-openshift-default-7b78b47f57-9lbtj to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-84f901-openshift-default-58866446d7-xfr7c to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-shfhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-shfhk to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m to ip-10-0-130-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5757ff5f4d-bfhxj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5757ff5f4d-bfhxj to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77 to ip-10-0-135-178.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-ff5d646d-d5xlp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-ff5d646d-d5xlp to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-cwl6l

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-cwl6l to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn to ip-10-0-130-52.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-rdfxp

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-rdfxp to ip-10-0-135-178.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5757ff5f4d-kj29g

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5757ff5f4d-kj29g to ip-10-0-128-161.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-f7847d4fb-xsn8q

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-f7847d4fb-xsn8q to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-d5dmn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-d5dmn to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-319188-openshift-default-5bb45bd965-n24w5 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs to ip-10-0-130-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-57db8b5885-9ncq2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-57db8b5885-9ncq2 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84 to ip-10-0-128-161.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-d65b6b7bb-k98hf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d65b6b7bb-k98hf to ip-10-0-130-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-59cd9876d5-km8cr

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-59cd9876d5-km8cr to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-689986b98c-m284n

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-689986b98c-m284n to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-f8lmw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-f8lmw to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2 to ip-10-0-135-178.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5d5f6f949f-mmc9m

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5d5f6f949f-mmc9m to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-jqmqc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-jqmqc to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-fmzmj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-fmzmj to ip-10-0-130-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5d5f6f949f-sffgp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5d5f6f949f-sffgp to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj to ip-10-0-135-178.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-9f8bd7d97-kfm4f

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-9f8bd7d97-kfm4f to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-flf8w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-flf8w to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j to ip-10-0-130-52.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6494c5b757-s2z9w

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6494c5b757-s2z9w to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-mfvmc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-mfvmc to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-qbpx6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-qbpx6 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-xr9v5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-xr9v5 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-x6r22

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-x6r22 to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd to ip-10-0-128-161.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-656f4b7695-wg98h

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-656f4b7695-wg98h to ip-10-0-135-178.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2 to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2n4q to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-qm4kr to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt to ip-10-0-135-178.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6b4fdd8ddc-ctw4d

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b4fdd8ddc-ctw4d to ip-10-0-128-161.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-sb5c9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-sb5c9 to ip-10-0-130-52.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7dc99f8759 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x2)

openshift-ingress

replicaset-controller

router-default-7dc99f8759

FailedCreate

Error creating: pods "router-default-7dc99f8759-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-7dc99f8759

SuccessfulCreate

Created pod: router-default-7dc99f8759-pzknq
(x5)

openshift-ingress

kubelet

router-default-7dc99f8759-pzknq

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7dc99f8759-pzknq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x2)

openshift-ingress

kubelet

router-default-7dc99f8759-pzknq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x2)

openshift-ingress

kubelet

router-default-7dc99f8759-pzknq

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-7dc99f8759-pzknq

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

router-default-7dc99f8759-pzknq

Created

Container created

openshift-ingress

kubelet

router-default-7dc99f8759-pzknq

Started

Container started

openshift-ingress

multus

router-default-7dc99f8759-pzknq

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-jqmqc

AddedInterface

Add eth0 [10.134.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jqmqc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-jqmqc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jqmqc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.168s (3.168s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jqmqc

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jqmqc

Started

Container started

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-689986b98c from 0 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-2h8ll

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-689986b98c

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-689986b98c-m284n

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-689986b98c-m284n

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-m284n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-2h8ll

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.583s (11.583s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-m284n

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-m284n

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-m284n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.012s (12.012s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-597bf9dc6d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-597bf9dc6d-pz44x

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

AddedInterface

Add eth0 [10.134.0.13/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-597bf9dc6d from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-597bf9dc6d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-597bf9dc6d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.91s (2.91s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.867s (2.867s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.938s (2.938s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 383ms (383ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 424ms (424ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz_06c0fd82-19ba-4860-b399-9d6bfda40d20

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-597bf9dc6d-mxkdz_06c0fd82-19ba-4860-b399-9d6bfda40d20 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 405ms (405ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-pz44x

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-597bf9dc6d-qbdqh

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-8qj9c

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-7jcqr

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-7jcqr

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-7jcqr

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-tbbnz

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-tbbnz

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tbbnz

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-7jcqr

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.046s (3.046s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-7jcqr

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-7jcqr

Started

Container started

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-4dv9m

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-4dv9m

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-4dv9m

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-dpr68

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-tpc9x

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-dpr68

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-dpr68

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tbbnz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.294s (5.294s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tbbnz

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tbbnz

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-tpc9x

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-597b95cb84-tpc9x

AddedInterface

Add eth0 [10.134.0.14/23] from ovn-kubernetes

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-tbbnz_d3b26cdf-e77d-41e0-99f0-f3b8ec393960

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-tbbnz_d3b26cdf-e77d-41e0-99f0-f3b8ec393960 became leader

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-4dv9m

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.308s (3.308s including waiting). Image size: 309650901 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-rdfxp

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-4dv9m

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-4dv9m

Created

Container created

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-rdfxp

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kuadrant-system

dns-operator-controller-manager-8557cbdb84-dpr68_107ae7cf-bb91-497d-a330-2e3dbec5dccb

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-dpr68_107ae7cf-bb91-497d-a330-2e3dbec5dccb became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-dpr68

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.367s (2.367s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-dpr68

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-dpr68

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rdfxp

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-cs5q5

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-cs5q5

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-cs5q5

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rdfxp

Created

Container created

openshift-ingress

replicaset-controller

kube-auth-proxy-64cbf78866

SuccessfulCreate

Created pod: kube-auth-proxy-64cbf78866-vhxkm

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rdfxp

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.056s (2.056s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-rdfxp_d5875111-127d-4f11-8871-f1eab414aa87 became leader

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-rdfxp

Started

Container started

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-64cbf78866 from 0 to 2

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-dtgm8

openshift-ingress

replicaset-controller

kube-auth-proxy-64cbf78866

SuccessfulCreate

Created pod: kube-auth-proxy-64cbf78866-9kpj2

cert-manager

kubelet

cert-manager-597b95cb84-tpc9x

Started

Container started

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-57dc67465 from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-57dc67465

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-57dc67465-62gx5

cert-manager

kubelet

cert-manager-597b95cb84-tpc9x

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

cert-manager

kubelet

cert-manager-597b95cb84-tpc9x

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.728s (3.728s including waiting). Image size: 309650901 bytes.

openshift-ingress

multus

kube-auth-proxy-64cbf78866-vhxkm

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-9kpj2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dtgm8

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

openshift-ingress

multus

kube-auth-proxy-64cbf78866-9kpj2

AddedInterface

Add eth0 [10.134.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-vhxkm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-dtgm8

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-57dc67465-62gx5

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-57dc67465-62gx5

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-57dc67465-62gx5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-57dc67465-62gx5

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-jclms

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-jclms

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-vhxkm

Created

Container created

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-jclms

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-9kpj2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.356s (2.356s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-9kpj2

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-9kpj2

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-vhxkm

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-64cbf78866-vhxkm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.361s (2.361s including waiting). Image size: 188904677 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dwfh7

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-dwfh7
(x7)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-dwfh7

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

kuadrant-system

authorino-operator-7b7bb4bc77-dtgm8_f85e614c-3ca1-4885-b505-4df41880509a

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-dtgm8_f85e614c-3ca1-4885-b505-4df41880509a became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dtgm8

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dtgm8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 4.08s (4.08s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-dtgm8

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dwfh7

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dwfh7

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dwfh7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.055s (2.055s including waiting). Image size: 177967631 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-jclms

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-jclms

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-jclms

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.572s (2.572s including waiting). Image size: 195729000 bytes.

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dwfh7_85c2e11b-9221-4679-ba8d-626c058749d9

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-dwfh7_85c2e11b-9221-4679-ba8d-626c058749d9 became leader

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-7rkvg

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-cs5q5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 8.249s (8.249s including waiting). Image size: 342538866 bytes.

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-cs5q5

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-cs5q5

Created

Container created

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-7rkvg

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7rkvg

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7rkvg

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7rkvg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.097s (4.097s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-7rkvg

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub

kserve-module-controller-manager-7566cf5fc8-jclms_255211cf-7fb7-4d60-8cf4-9b740fe8dadf

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-jclms_255211cf-7fb7-4d60-8cf4-9b740fe8dadf became leader

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-8d5b9"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-6k75l"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-tbbnz

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tbbnz

Killing

Stopping container manager

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-57fd4644b5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-57fd4644b5

SuccessfulCreate

Created pod: jobset-controller-manager-57fd4644b5-9vmrb

openshift-jobset-operator

kubelet

jobset-controller-manager-57fd4644b5-9vmrb

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-57fd4644b5-9vmrb

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-jobset-operator

jobset-controller-manager-57fd4644b5-9vmrb_c83d5fb6-6ba4-4c8f-b9d5-9b2e13d3c6e4

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-57fd4644b5-9vmrb_c83d5fb6-6ba4-4c8f-b9d5-9b2e13d3c6e4 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-57fd4644b5-9vmrb

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.115s (3.115s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-57fd4644b5-9vmrb

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-57fd4644b5-9vmrb

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-jpzw8

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-7rkvg_9fe0b8d5-a418-4355-9b7a-b18f158c8f48

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-7rkvg_9fe0b8d5-a418-4355-9b7a-b18f158c8f48 became leader

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-jpzw8

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jpzw8

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-27ckg

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-qwdhc

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-zpnjg

kuadrant-system

multus

limitador-limitador-7c9b87d574-qwdhc

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-zpnjg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

multus

authorino-56c6c9ddd5-zpnjg

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-27ckg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-27ckg

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-qwdhc

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-qwdhc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.68s (1.68s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-qwdhc

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-qwdhc

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jpzw8

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jpzw8

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jpzw8

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.089s (3.089s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-27ckg

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-zpnjg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.638s (2.638s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-27ckg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.815s (2.815s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-27ckg

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-zpnjg

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-zpnjg

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-27ckg

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-27ckg

Killing

Stopping container authorino

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-chpzx

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-btqgb

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-htl5n

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-jvp24

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

Started

Container started

opendatahub

multus

kserve-controller-manager-776cc66d47-chpzx

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-jvp24

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-btqgb

FailedMount

MountVolume.SetUp failed for volume "cert" : secret "odh-model-controller-webhook-cert" not found

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-qm4kr

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

multus

model-serving-api-75bd89fdfc-htl5n

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

kubelet

kserve-controller-manager-776cc66d47-chpzx

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jvp24

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-htl5n

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-jpzw8

Killing

Stopping container limitador

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

odh-model-controller-769875db56-btqgb

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

multus

odh-model-controller-769875db56-btqgb

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-jpzw8

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-jqmqc

Killing

Stopping container discovery

opendatahub

kubelet

model-serving-api-75bd89fdfc-htl5n

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jvp24

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jvp24

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-htl5n

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-jqmqc

opendatahub

kubelet

model-serving-api-75bd89fdfc-htl5n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.213s (2.213s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jvp24

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 1.809s (1.809s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-chpzx

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.693s (2.693s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-chpzx

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-chpzx

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-btqgb

Created

Container created

opendatahub

odh-model-controller-769875db56-btqgb_d381fc9b-ef81-4205-a175-4c153bca1438

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-btqgb_d381fc9b-ef81-4205-a175-4c153bca1438 became leader

opendatahub

kserve-controller-manager-776cc66d47-chpzx_018a4bf1-7da7-4688-bb28-fb843b801556

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-chpzx_018a4bf1-7da7-4688-bb28-fb843b801556 became leader

opendatahub

kubelet

odh-model-controller-769875db56-btqgb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.03s (3.03s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-btqgb

Started

Container started

opendatahub

llmisvc-controller-manager-869d5dcc5d-jvp24_fd4b1e96-3d3d-4782-b912-cc036000d953

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-jvp24_fd4b1e96-3d3d-4782-b912-cc036000d953 became leader

opendatahub

kubelet

maas-controller-67dcc64f86-rdbqv

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:698b11bccfa464176481b94fcc8bddca33508a6dffa8837c52ea7f8919fbdadd"

opendatahub

replicaset-controller

maas-controller-67dcc64f86

SuccessfulCreate

Created pod: maas-controller-67dcc64f86-rdbqv

opendatahub

multus

maas-controller-67dcc64f86-rdbqv

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-f5d6dd878 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-67dcc64f86 from 0 to 1

opendatahub

replicaset-controller

maas-controller-f5d6dd878

SuccessfulCreate

Created pod: maas-controller-f5d6dd878-twxgq

opendatahub

multus

maas-controller-f5d6dd878-twxgq

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-f5d6dd878-twxgq

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:698b11bccfa464176481b94fcc8bddca33508a6dffa8837c52ea7f8919fbdadd"

opendatahub

kubelet

maas-controller-67dcc64f86-rdbqv

Started

Container started

opendatahub

kubelet

maas-controller-67dcc64f86-rdbqv

Created

Container created

opendatahub

kubelet

maas-controller-f5d6dd878-twxgq

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:698b11bccfa464176481b94fcc8bddca33508a6dffa8837c52ea7f8919fbdadd" in 4.919s (4.919s including waiting). Image size: 200069651 bytes.

opendatahub

kubelet

maas-controller-67dcc64f86-rdbqv

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:698b11bccfa464176481b94fcc8bddca33508a6dffa8837c52ea7f8919fbdadd" in 5.322s (5.322s including waiting). Image size: 200069651 bytes.

opendatahub

maas-controller-f5d6dd878-twxgq_d0dfd8fc-ca2f-42af-b357-6acc7bc76961

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-f5d6dd878-twxgq_d0dfd8fc-ca2f-42af-b357-6acc7bc76961 became leader

opendatahub

kubelet

maas-controller-f5d6dd878-twxgq

Created

Container created

opendatahub

kubelet

maas-controller-f5d6dd878-twxgq

Started

Container started

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-rf52l

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-rf52l

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rf52l

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

maas-controller-67dcc64f86-rdbqv

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-67dcc64f86

SuccessfulDelete

Deleted pod: maas-controller-67dcc64f86-rdbqv

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-67dcc64f86 from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rf52l

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rf52l

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.911s (10.911s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-rf52l

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Unhealthy

Readiness probe failed: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

ProbeError

Readiness probe error: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6dd76875b5 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6dd76875b5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-2pqvr

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-798dd5cc85

SuccessfulCreate

Created pod: authorino-798dd5cc85-s2vpq

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulDelete

Deleted pod: authorino-6dd76875b5-8p6dg

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulCreate

Created pod: authorino-6dd76875b5-8p6dg

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-2pqvr

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-798dd5cc85 from 0 to 1

kuadrant-system

multus

authorino-798dd5cc85-s2vpq

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-798dd5cc85-s2vpq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-zpnjg

kuadrant-system

kubelet

authorino-56c6c9ddd5-zpnjg

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-798dd5cc85-s2vpq

Created

Container created

kuadrant-system

kubelet

authorino-798dd5cc85-s2vpq

Started

Container started

kuadrant-system

kubelet

authorino-798dd5cc85-s2vpq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.17s (1.17s including waiting). Image size: 204096810 bytes.

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-qnpf4
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Unhealthy

Startup probe failed: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qnpf4

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

ProbeError

Startup probe error: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused body:

opendatahub

multus

llmisvc-controller-manager-6466c554d8-qnpf4

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qnpf4

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qnpf4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 457ms (457ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-qnpf4

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-jvp24

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-jvp24

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-m2n56

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

multus

ai-gateway-controller-7d85675f98-m2n56

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-m2n56

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-7d85675f98-m2n56

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 3.669s (3.669s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-m2n56

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-m2n56

Created

Container created

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-fztgr

opendatahub

ai-gateway-controller-7d85675f98-m2n56_b4301216-3550-47a2-843f-4b4580b115b3

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-m2n56_b4301216-3550-47a2-843f-4b4580b115b3 became leader
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-shfhk

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-shfhk

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-shfhk

openshift-ingress

multus

payload-processing-55fbbbf9dc-fztgr

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-fztgr

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-fztgr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.38s (2.38s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-shfhk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.306s (2.306s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-fztgr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-shfhk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-shfhk

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-fztgr

Started

Container started

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-b47bd7b99 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-b47bd7b99

SuccessfulCreate

Created pod: ai-gateway-controller-b47bd7b99-gx47b

opendatahub

kubelet

ai-gateway-controller-b47bd7b99-gx47b

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-b47bd7b99-gx47b

Started

Container started

opendatahub

kubelet

ai-gateway-controller-b47bd7b99-gx47b

Created

Container created

opendatahub

kubelet

ai-gateway-controller-b47bd7b99-gx47b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 407ms (407ms including waiting). Image size: 183979433 bytes.

opendatahub

multus

ai-gateway-controller-b47bd7b99-gx47b

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

opendatahub

llmisvc-controller-manager-6466c554d8-qnpf4_0757661a-bae1-4289-812c-908633c60425

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-qnpf4_0757661a-bae1-4289-812c-908633c60425 became leader

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-m2n56

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-m2n56

Killing

Stopping container manager

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-hl2cc

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-hl2cc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-hzp87

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.485s (1.485s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-hl2cc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-hl2cc

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-hl2cc

Created

Container created

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-vgkmj

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vgkmj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-hl2cc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.242s (1.242s including waiting). Image size: 98346788 bytes.

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-vgkmj

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vgkmj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 327ms (327ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vgkmj

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vgkmj

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

opendatahub

ai-gateway-controller-b47bd7b99-gx47b_91b5a70f-8dbb-428a-8af5-cec59560638e

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-b47bd7b99-gx47b_91b5a70f-8dbb-428a-8af5-cec59560638e became leader

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-x27k5

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x27k5

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x27k5

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x27k5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 313ms (313ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x27k5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-x27k5

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 300ms (300ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gw4gd

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-gtxbn

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

multus

echo-simulator-kserve-64b6f8f96c-gtxbn

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-gtxbn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-d257f

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-d257f

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 324ms (324ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-gtxbn

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-d257f

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-d257f

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-d257f

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-d257f

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-gtxbn

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-gtxbn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.022s (2.022s including waiting). Image size: 78208878 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 313ms (313ms including waiting). Image size: 98346788 bytes.
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-7pzkt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-d5dmn

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-fmzmj

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-7pzkt

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-fmzmj

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-d5dmn

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.193s (3.193s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.573s (3.573s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

kuadrant-system

replicaset-controller

authorino-6f767f5f8

SuccessfulCreate

Created pod: authorino-6f767f5f8-dnjx6
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused

kuadrant-system

kubelet

authorino-6f767f5f8-dnjx6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

kuadrant-system

multus

authorino-6f767f5f8-dnjx6

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f767f5f8-dnjx6

Created

Container created

kuadrant-system

kubelet

authorino-6f767f5f8-dnjx6

Started

Container started

kuadrant-system

kubelet

authorino-798dd5cc85-s2vpq

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-798dd5cc85

SuccessfulDelete

Deleted pod: authorino-798dd5cc85-s2vpq

kuadrant-system

kubelet

authorino-6f767f5f8-dnjx6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 894ms (894ms including waiting). Image size: 204096810 bytes.
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-798dd5cc85 from 1 to 0

openshift-ingress

gateway_labeler_controller

e2e-ait-b612c7f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b612c7f2

openshift-ingress

gateway_labeler_controller

e2e-ait-67598f1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-67598f1d

openshift-ingress

deployment-controller

e2e-ait-67598f1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-67598f1d-openshift-default-cfc6b86c7 from 0 to 1

openshift-ingress

multus

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-b612c7f2-openshift-default-6fb7f7b587

SuccessfulCreate

Created pod: e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

openshift-ingress

deployment-controller

e2e-ait-b612c7f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b612c7f2-openshift-default-6fb7f7b587 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9

SuccessfulCreate

Created pod: e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

openshift-ingress

deployment-controller

e2e-migrate-8f46c771-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8f46c771-gw-openshift-default-76467b7b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-8f46c771-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8f46c771-gw

openshift-ingress

replicaset-controller

e2e-ait-67598f1d-openshift-default-cfc6b86c7

SuccessfulCreate

Created pod: e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

openshift-ingress

multus

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-b16c21be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b16c21be

openshift-ingress

deployment-controller

e2e-ait-b16c21be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b16c21be-openshift-default-8598bb4d8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b16c21be-openshift-default-8598bb4d8f

SuccessfulCreate

Created pod: e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

openshift-ingress

multus

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b612c7f2-75746f7d9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b612c7f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b612c7f2-8486646d87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b612c7f2-8486646d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b612c7f2-8486646d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b612c7f2-8486646d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b612c7f2: serviceaccount "payload-processing-e2e-ait-b612c7f2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b612c7f2-75746f7d9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b612c7f2-75746f7d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b612c7f2: serviceaccount "payload-processing-e2e-ait-b612c7f2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b612c7f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b612c7f2-75746f7d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-67598f1d-6db88fd7dc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-67598f1d-6db88fd7dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-67598f1d: serviceaccount "payload-processing-e2e-ait-67598f1d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-67598f1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-67598f1d-6db88fd7dc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-67598f1d-7cb658879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-67598f1d-7cb658879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-67598f1d: serviceaccount "payload-processing-e2e-ait-67598f1d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-67598f1d-7cb658879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-67598f1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-67598f1d-7cb658879 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-67598f1d-6db88fd7dc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8f46c771: serviceaccount "payload-processing-e2e-migrate-8f46c771" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8f46c771-667cf6645c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8f46c771-667cf6645c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8f46c771: serviceaccount "payload-processing-e2e-migrate-8f46c771" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8f46c771-667cf6645c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8f46c771

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8f46c771-667cf6645c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8f46c771

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8f46c771-bbf76899f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

openshift-ingress

multus

payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b16c21be-c777df947

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b16c21be-c777df947-zkld5

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b16c21be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b16c21be-c777df947 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b16c21be-c777df947

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b16c21be-c777df947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b16c21be: serviceaccount "payload-processing-e2e-ait-b16c21be" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b16c21be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b16c21be-7549f65d9f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b16c21be: serviceaccount "payload-processing-e2e-ait-b16c21be" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-b16c21be-c777df947-zkld5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-b16c21be-c777df947-zkld5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-b16c21be-c777df947-zkld5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-b16c21be-c777df947-zkld5

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.923s (1.923s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.492s (1.492s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.98s (2.98s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.059s (2.059s including waiting). Image size: 125353965 bytes.

openshift-ingress

deployment-controller

e2e-derive-eaf151e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-eaf151e7-openshift-default-668cb9db45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-eaf151e7-openshift-default-668cb9db45

SuccessfulCreate

Created pod: e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

openshift-ingress

gateway_labeler_controller

e2e-derive-eaf151e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-eaf151e7

openshift-ingress

multus

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-eaf151e7-777b69d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-eaf151e7-777b69d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-eaf151e7: serviceaccount "payload-processing-e2e-derive-eaf151e7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-derive-eaf151e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-eaf151e7-5996b6df49 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-eaf151e7-5996b6df49

SuccessfulCreate

Created pod: payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx

openshift-ingress

multus

payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-eaf151e7-5996b6df49

FailedCreate

Error creating: pods "payload-processing-e2e-derive-eaf151e7-5996b6df49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-eaf151e7: serviceaccount "payload-processing-e2e-derive-eaf151e7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-eaf151e7-777b69d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d

openshift-ingress

kubelet

payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-eaf151e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-eaf151e7-777b69d7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Started

Container started

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Created

Container created

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b612c7f2-8486646d87-sjvml

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b612c7f2-75746f7d9-xh6h6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b612c7f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b612c7f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-8f46c771-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-8f46c771-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b16c21be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-b16c21be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-8f46c771-667cf6645c-hcqvc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8f46c771-bbf76899f-52t62

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-53aa47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-53aa47

openshift-ingress

replicaset-controller

e2e-worker-w4-53aa47-openshift-default-9cbf98959

SuccessfulCreate

Created pod: e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

openshift-ingress

deployment-controller

e2e-worker-w4-53aa47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53aa47-openshift-default-9cbf98959 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-8f46c771-gw-openshift-default-76467b7b9-z2mn9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-f9a819

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-f9a819

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 0 to 1

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-b612c7f2-openshift-default-6fb7f7b587-nsgrq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-eaf151e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-eaf151e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-53aa47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-53aa47-67f966d869 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-53aa47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-53aa47-76d657f955 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-53aa47: serviceaccount "payload-processing-e2e-worker-w4-53aa47" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-53aa47-67f966d869

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-53aa47-67f966d869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-53aa47: serviceaccount "payload-processing-e2e-worker-w4-53aa47" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16c21be-7549f65d9f-pxz4n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-b16c21be-c777df947-zkld5

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-53aa47-67f966d869

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eaf151e7-777b69d7-vkp6d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-eaf151e7-5996b6df49-sv2qx

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-f9a819-79dd6b768f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

openshift-ingress

kubelet

payload-processing-e2e-ait-67598f1d-6db88fd7dc-xrmbv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67598f1d-7cb658879-swx2g

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-f9a819

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-f9a819-79dd6b768f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-f9a819

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-f9a819: serviceaccount "payload-processing-e2e-worker-w3-f9a819" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-f9a819-79dd6b768f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-f9a819-79dd6b768f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-f9a819: serviceaccount "payload-processing-e2e-worker-w3-f9a819" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-eaf151e7-openshift-default-668cb9db45-jqz2r

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-67598f1d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-67598f1d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-317a33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-317a33

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 0 to 1

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-bc102e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-bc102e

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-b16c21be-openshift-default-8598bb4d8f-tbpp6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-67598f1d-openshift-default-cfc6b86c7-pm6v8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-8e4acb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-8e4acb

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-317a33: serviceaccount "payload-processing-e2e-worker-w1-317a33" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-317a33-74fbf67dcc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-317a33-74fbf67dcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-317a33: serviceaccount "payload-processing-e2e-worker-w1-317a33" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-317a33-74fbf67dcc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-317a33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-317a33-74fbf67dcc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-317a33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-317a33-849fd968c5 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-bc102e-779576d99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-bc102e-779576d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-bc102e: serviceaccount "payload-processing-e2e-worker-w0-bc102e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-bc102e-779576d99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-bc102e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-bc102e-779576d99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-bc102e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-bc102e-555d6fdb7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-bc102e: serviceaccount "payload-processing-e2e-worker-w0-bc102e" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-8e4acb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-8e4acb-9797567d5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-8e4acb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-8e4acb-9797567d5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-8e4acb: serviceaccount "payload-processing-e2e-worker-w2-8e4acb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-8e4acb-9797567d5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-8e4acb-9797567d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-8e4acb: serviceaccount "payload-processing-e2e-worker-w2-8e4acb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-53aa47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53aa47-openshift-default-9cbf98959 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-53aa47-openshift-default-9cbf98959

SuccessfulCreate

Created pod: e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

openshift-ingress

multus

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-d65b6b7bb-k98hf

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d65b6b7bb from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-d65b6b7bb-k98hf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-d65b6b7bb

SuccessfulCreate

Created pod: payload-processing-external-model-d65b6b7bb-k98hf
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-d65b6b7bb

FailedCreate

Error creating: pods "payload-processing-external-model-d65b6b7bb-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 1 to 2

models-as-a-service

kubelet

payload-processing-external-model-d65b6b7bb-k98hf

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

models-as-a-service

kubelet

payload-processing-external-model-d65b6b7bb-k98hf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

Started

Container started

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-f8lmw

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-f8lmw

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-f8lmw

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-mfvmc

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-mfvmc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 4 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-f8lmw

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-f8lmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

Created

Container created

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-f8lmw

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-f8lmw

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

Created

Container created

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-656f4b7695

SuccessfulCreate

Created pod: payload-processing-external-model-656f4b7695-wg98h

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-656f4b7695 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-656f4b7695-wg98h

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-656f4b7695-wg98h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-656f4b7695-wg98h

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-656f4b7695-wg98h

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-6nj94

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-sb5c9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-cwl6l

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-6nj94

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-sb5c9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-sb5c9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-77f556d647-b8h86

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-sb5c9

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 3 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8h86

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8h86

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-b8h86

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-cwl6l

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-sb5c9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8h86

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

Started

Container started

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

Started

Container started

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-d65b6b7bb from 1 to 0
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-d65b6b7bb-k98hf

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8h86

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-d65b6b7bb

SuccessfulDelete

Deleted pod: payload-processing-external-model-d65b6b7bb-k98hf
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8h86

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-sb5c9

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-sb5c9

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-mmc9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5d5f6f949f-mmc9m

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f6f949f

SuccessfulCreate

Created pod: payload-processing-external-model-5d5f6f949f-mmc9m

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-mmc9m

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-mmc9m

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-656f4b7695 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-656f4b7695

SuccessfulDelete

Deleted pod: payload-processing-external-model-656f4b7695-wg98h

models-as-a-service

kubelet

payload-processing-external-model-656f4b7695-wg98h

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-57db8b5885 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-57db8b5885

SuccessfulCreate

Created pod: payload-processing-external-model-57db8b5885-9ncq2

models-as-a-service

kubelet

payload-processing-external-model-57db8b5885-9ncq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-57db8b5885-9ncq2

Created

Container created

models-as-a-service

multus

payload-processing-external-model-57db8b5885-9ncq2

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-57db8b5885-9ncq2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

Created

Container created

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 5 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f6f949f

SuccessfulDelete

Deleted pod: payload-processing-external-model-5d5f6f949f-mmc9m

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5d5f6f949f from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-mmc9m

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 4 to 6

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

Started

Container started

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

Created

Container created

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-k2n4q

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x9)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.018s (4.018s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k2n4q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 6 to 8

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 6 to 10

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 5 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Started

Container started
(x3)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-5d5f6f949f

SuccessfulCreate

Created pod: payload-processing-external-model-5d5f6f949f-sffgp
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5d5f6f949f from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-sffgp

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5d5f6f949f-sffgp

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-sffgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-sffgp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

Created

Container created

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 9 to 10

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 8 to 10

openshift-ingress

multus

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

ProbeError

Readiness probe error: Get "http://10.133.0.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Unhealthy

Readiness probe failed: Get "http://10.133.0.16:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Unhealthy

Readiness probe failed: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

ProbeError

Readiness probe error: Get "http://10.134.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-f8lmw

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-f8lmw

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-57db8b5885

SuccessfulDelete

Deleted pod: payload-processing-external-model-57db8b5885-9ncq2

models-as-a-service

kubelet

payload-processing-external-model-57db8b5885-9ncq2

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-57db8b5885 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-5d5f6f949f-sffgp

Killing

Stopping container payload-processing
(x10)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x12)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8h86

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8h86

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

Started

Container started

openshift-ingress

deployment-controller

e2e-mt-a52bd2a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a52bd2a1-openshift-default-58f58875f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-a52bd2a1-openshift-default-58f58875f7

SuccessfulCreate

Created pod: e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-a52bd2a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a52bd2a1

openshift-ingress

multus

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-a-1fac16-openshift-default-cdc6dff7c

SuccessfulCreate

Created pod: e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

openshift-ingress

gateway_labeler_controller

e2e-api-a-1fac16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1fac16

openshift-ingress

deployment-controller

e2e-api-a-1fac16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1fac16-openshift-default-cdc6dff7c from 0 to 1

openshift-ingress

multus

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a52bd2a1: serviceaccount "payload-processing-e2e-mt-a52bd2a1" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a52bd2a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a52bd2a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a52bd2a1-f96449b5f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a52bd2a1-f96449b5f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a52bd2a1-f96449b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a52bd2a1: serviceaccount "payload-processing-e2e-mt-a52bd2a1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a52bd2a1-f96449b5f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1fac16: serviceaccount "payload-processing-e2e-api-a-1fac16" not found

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 6; reason:

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1fac16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1fac16-cb48df6c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1fac16-cb48df6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1fac16: serviceaccount "payload-processing-e2e-api-a-1fac16" not found

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1fac16-cb48df6c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1fac16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1fac16-cb48df6c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-53aa47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53aa47-openshift-default-9cbf98959 from 2 to 4

openshift-ingress

kubelet

payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-53aa47-openshift-default-9cbf98959

SuccessfulCreate

Created pod: e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

openshift-ingress

replicaset-controller

e2e-worker-w4-53aa47-openshift-default-9cbf98959

SuccessfulCreate

Created pod: e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Unhealthy

Liveness probe failed: Get "https://10.133.0.37:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

Unhealthy

Readiness probe failed: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

ProbeError

Readiness probe error: Get "http://10.132.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-95a684-openshift-default-7dd56b5cf9

SuccessfulCreate

Created pod: e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

openshift-ingress

gateway_labeler_controller

e2e-api-a-95a684

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-95a684

openshift-ingress

deployment-controller

e2e-api-a-95a684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-95a684-openshift-default-7dd56b5cf9 from 0 to 1

openshift-ingress

multus

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-95a684-7cb5598977

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-95a684-7cb5598977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-95a684: serviceaccount "payload-processing-e2e-api-a-95a684" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-95a684: serviceaccount "payload-processing-e2e-api-a-95a684" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-95a684

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-95a684-56fb6cb85f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-95a684-7cb5598977

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-95a684

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-95a684-7cb5598977 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-a52bd2a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-a52bd2a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-a-1982ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1982ff

openshift-ingress

replicaset-controller

e2e-api-a-1982ff-openshift-default-d7d5775d9

SuccessfulCreate

Created pod: e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

openshift-ingress

deployment-controller

e2e-api-a-1982ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1982ff-openshift-default-d7d5775d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-49990a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-49990a

openshift-ingress

multus

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-49990a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-49990a-openshift-default-6bdfd54755 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-49990a-openshift-default-6bdfd54755

SuccessfulCreate

Created pod: e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

openshift-ingress

multus

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1982ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1982ff-78b566b7c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1982ff: serviceaccount "payload-processing-e2e-api-a-1982ff" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1982ff-78b566b7c5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1982ff-78b566b7c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1982ff: serviceaccount "payload-processing-e2e-api-a-1982ff" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1982ff-78b566b7c5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1982ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1982ff-75465cb8c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756

openshift-ingress

multus

payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-49990a: serviceaccount "payload-processing-e2e-api-b-49990a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-49990a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-49990a-57945d5ccc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-49990a-57945d5ccc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-49990a-57945d5ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-49990a: serviceaccount "payload-processing-e2e-api-b-49990a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-49990a-57945d5ccc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-49990a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-49990a-bb6cd55dc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1982ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1982ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-a-1fac16-openshift-default-cdc6dff7c

SuccessfulCreate

Created pod: e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v
(x2)

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-a-1fac16-openshift-default-cdc6dff7c

SuccessfulCreate

Created pod: e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8
(x2)

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1fac16-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-a-1fac16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1fac16-openshift-default-cdc6dff7c from 1 to 3

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

Unhealthy

Readiness probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

ProbeError

Readiness probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

Started

Container started

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

Created

Container created

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

Created

Container created

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

Started

Container started

openshift-ingress

multus

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

Created

Container created

openshift-ingress

multus

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

Started

Container started

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-api-b-84f901

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-84f901
(x5)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-84f901-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-84f901-openshift-default-58866446d7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-84f901-openshift-default-58866446d7

SuccessfulCreate

Created pod: e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-flf8w

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-flf8w

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-flf8w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-84f901-ff44cf6df

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-84f901-ff44cf6df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-84f901: serviceaccount "payload-processing-e2e-api-b-84f901" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-84f901

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-84f901-ff44cf6df

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-84f901: serviceaccount "payload-processing-e2e-api-b-84f901" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-84f901

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-84f901-ff44cf6df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-flf8w

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-flf8w

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-flf8w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.802s (4.802s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-flf8w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-flf8w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.719s (4.719s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.765s (4.766s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-0333a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0333a9

openshift-ingress

deployment-controller

e2e-api-b-0333a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0333a9-openshift-default-54cffbc65 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-0333a9-openshift-default-54cffbc65

SuccessfulCreate

Created pod: e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

openshift-ingress

multus

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-95a684-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-95a684-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0333a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0333a9-7454578bbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0333a9-7454578bbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6
(x2)

openshift-ingress

kubelet

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0333a9-7454578bbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0333a9-7454578bbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0333a9: serviceaccount "payload-processing-e2e-api-b-0333a9" not found
(x2)

openshift-ingress

kubelet

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0333a9-9449bf987

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0333a9-9449bf987

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0333a9-9449bf987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0333a9: serviceaccount "payload-processing-e2e-api-b-0333a9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0333a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0333a9-9449bf987 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-a52bd2a1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-a52bd2a1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1fac16-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1fac16-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-49990a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-49990a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1fac16-645f4f8ff5-hl7cn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1fac16-cb48df6c-vtf28

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-49990a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-49990a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-95a684-7cb5598977-lkkjd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95a684-56fb6cb85f-sjhp2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-84f901-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-84f901-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1982ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1982ff-75465cb8c5-nt756

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-7615-065799

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

kubelet

payload-processing-e2e-api-a-1982ff-78b566b7c5-kjpv6

Killing

Stopping container payload-processing

opendatahub

multus

test-curl-7615-065799

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-1982ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-mdq5v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-lq4sl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

Started

Container started

openshift-ingress

kubelet

e2e-api-a-1fac16-openshift-default-cdc6dff7c-z8jx8

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7615-065799

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 6.303s (6.303s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7615-065799

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-95a684-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-95a684-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7615-065799

Started

Container started

opendatahub

kubelet

test-curl-7615-065799

Killing

Stopping container test-curl-7615-065799
(x6)

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-49990a-57945d5ccc-6bl92

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-49990a-bb6cd55dc-d7c4z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0333a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0333a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-84f901-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-84f901-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-1982ff-openshift-default-d7d5775d9-gsmhq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-95a684-openshift-default-7dd56b5cf9-sj9pj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-84f901-ff44cf6df-9m2nw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84f901-56d5f4f4c9-9tq8r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-49990a-openshift-default-6bdfd54755-f8c2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-0333a9-9449bf987-tq4h5

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0333a9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-0333a9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0333a9-7454578bbc-g76f6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-797b8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-mdwqj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a52bd2a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a52bd2a1-f96449b5f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a52bd2a1-f96449b5f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a52bd2a1-f96449b5f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a52bd2a1-f96449b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a52bd2a1: serviceaccount "payload-processing-e2e-mt-a52bd2a1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a52bd2a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a52bd2a1: serviceaccount "payload-processing-e2e-mt-a52bd2a1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g

Started

Container started

openshift-ingress

kubelet

e2e-api-b-84f901-openshift-default-58866446d7-xfr7c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0333a9-openshift-default-54cffbc65-q7hx5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695

SuccessfulCreate

Created pod: e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-5e71c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-5e71c9

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-eebcb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-eebcb4

openshift-ingress

deployment-controller

e2e-ipp-a-eebcb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-eebcb4-openshift-default-74d678989 from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-a-5e71c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-eebcb4-openshift-default-74d678989

SuccessfulCreate

Created pod: e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

openshift-ingress

multus

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-eebcb4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-eebcb4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-eebcb4-599fc8f499 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eebcb4-599fc8f499

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-eebcb4-599fc8f499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eebcb4: serviceaccount "payload-processing-e2e-ipp-a-eebcb4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eebcb4-599fc8f499

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eebcb4: serviceaccount "payload-processing-e2e-ipp-a-eebcb4" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5e71c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5e71c9-68c969bc89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5e71c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5e71c9-68c969bc89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5e71c9-68c969bc89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5e71c9: serviceaccount "payload-processing-e2e-ipp-a-5e71c9" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5e71c9-68c969bc89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5e71c9: serviceaccount "payload-processing-e2e-ipp-a-5e71c9" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-7c14e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7c14e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7c14e2

openshift-ingress

replicaset-controller

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c

SuccessfulCreate

Created pod: e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

openshift-ingress

multus

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7c14e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7c14e2-b567c487 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7c14e2-7ff887648f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7c14e2-7ff887648f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7c14e2: serviceaccount "payload-processing-e2e-ipp-a-7c14e2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7c14e2: serviceaccount "payload-processing-e2e-ipp-a-7c14e2" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7c14e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7c14e2-7ff887648f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7c14e2-7ff887648f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69

Started

Container started

opendatahub

kubelet

test-curl-7615-4398ef

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7615-4398ef

Created

Container created

opendatahub

multus

test-curl-7615-4398ef

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7615-4398ef

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-6b98c99b7-vnmsz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-599fc8f499-xdc2m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-68c969bc89-qszlh

Killing

Stopping container payload-processing

opendatahub

kubelet

test-curl-7615-4398ef

Killing

Stopping container test-curl-7615-4398ef

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-8444cbd59f-jmxtn

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eebcb4: serviceaccount "payload-processing-e2e-ipp-a-eebcb4" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eebcb4: serviceaccount "payload-processing-e2e-ipp-a-eebcb4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-eebcb4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-eebcb4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5e71c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5e71c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5e71c9-9599987c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5e71c9-9599987c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5e71c9-9599987c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5e71c9: serviceaccount "payload-processing-e2e-ipp-a-5e71c9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5e71c9-9599987c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5e71c9: serviceaccount "payload-processing-e2e-ipp-a-5e71c9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Unhealthy

Readiness probe failed: Get "http://10.134.0.105:15021/healthz/ready": read tcp 10.134.0.2:48800->10.134.0.105:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a52bd2a1-84d6b89f-ln64d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a52bd2a1-f96449b5f-mts7g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

ProbeError

Readiness probe error: Get "http://10.134.0.105:15021/healthz/ready": read tcp 10.134.0.2:48800->10.134.0.105:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

ProbeError

Readiness probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Unhealthy

Readiness probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.3s (4.3s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.457s (4.457s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.912s (2.912s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.23s (3.23s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-b567c487-x7f9l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-7ff887648f-fdm69

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eebcb4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eebcb4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7c14e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7c14e2-5cb65d4778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp

openshift-ingress

deployment-controller

e2e-api-a-319188-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-319188-openshift-default-5bb45bd965 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7c14e2: serviceaccount "payload-processing-e2e-ipp-a-7c14e2" not found

openshift-ingress

replicaset-controller

e2e-api-a-319188-openshift-default-5bb45bd965

SuccessfulCreate

Created pod: e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

openshift-ingress

gateway_labeler_controller

e2e-api-a-319188

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-319188
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7c14e2: serviceaccount "payload-processing-e2e-ipp-a-7c14e2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7c14e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.507s (1.507s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97

SuccessfulCreate

Created pod: e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

openshift-ingress

multus

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a61855

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a61855

openshift-ingress

deployment-controller

e2e-ipp-b-a61855-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a61855-openshift-default-8596696d9c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c5bf9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c5bf9a

openshift-ingress

replicaset-controller

e2e-ipp-b-a61855-openshift-default-8596696d9c

SuccessfulCreate

Created pod: e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

openshift-ingress

deployment-controller

e2e-ipp-b-c5bf9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-319188-59f459b575

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-319188-59f459b575-r26vz

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-319188

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-319188-59f459b575 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-319188-59f459b575

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-319188-59f459b575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-319188: serviceaccount "payload-processing-e2e-api-a-319188" not found
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-319188-5db4ddbd87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-319188-5db4ddbd87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-319188: serviceaccount "payload-processing-e2e-api-a-319188" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-319188-5db4ddbd87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-319188

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-319188-5db4ddbd87 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-319188-59f459b575-r26vz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-319188-59f459b575-r26vz

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-319188-59f459b575-r26vz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-319188-59f459b575-r26vz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c5bf9a: serviceaccount "payload-processing-e2e-ipp-b-c5bf9a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c5bf9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c5bf9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c5bf9a: serviceaccount "payload-processing-e2e-ipp-b-c5bf9a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a61855-7b7d46dff9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a61855-7b7d46dff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a61855: serviceaccount "payload-processing-e2e-ipp-b-a61855" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl

Created

Container created
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a61855: serviceaccount "payload-processing-e2e-ipp-b-a61855" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a61855

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a61855-7b7d46dff9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a61855

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a61855-7b7d46dff9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eebcb4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5e71c9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5e71c9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eebcb4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-351fd1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-351fd1

openshift-ingress

deployment-controller

e2e-ipp-b-351fd1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-351fd1-openshift-default-74f5c98f57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-351fd1-openshift-default-74f5c98f57

SuccessfulCreate

Created pod: e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

openshift-ingress

multus

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-351fd1: serviceaccount "payload-processing-e2e-ipp-b-351fd1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-351fd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-351fd1-584c5df55

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-351fd1-584c5df55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-351fd1: serviceaccount "payload-processing-e2e-ipp-b-351fd1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-351fd1-584c5df55

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-351fd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-351fd1-584c5df55 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-5452c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-5452c3

openshift-ingress

deployment-controller

e2e-api-b-5452c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-5452c3-openshift-default-7bcf44b967 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-5452c3-openshift-default-7bcf44b967

SuccessfulCreate

Created pod: e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

openshift-ingress

multus

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-7d4f95cdf5-prgwb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-6b945b7c55-w5zwl

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-5452c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-5452c3-798c5694b9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5452c3-798c5694b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-5452c3-798c5694b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5452c3: serviceaccount "payload-processing-e2e-api-b-5452c3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-c98d5dd55-nn6zg

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-5452c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5452c3-798c5694b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5452c3: serviceaccount "payload-processing-e2e-api-b-5452c3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-7b7d46dff9-55t6b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6

Started

Container started

openshift-ingress

kubelet

e2e-mt-a52bd2a1-openshift-default-58f58875f7-hqk28

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7c14e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7c14e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c5bf9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c5bf9a: serviceaccount "payload-processing-e2e-ipp-b-c5bf9a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c5bf9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c5bf9a: serviceaccount "payload-processing-e2e-ipp-b-c5bf9a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a61855: serviceaccount "payload-processing-e2e-ipp-b-a61855" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a61855

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a61855-59c8f6c6dd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a61855

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a61855-6c677847 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a61855-6c677847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a61855-6c677847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a61855-6c677847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a61855: serviceaccount "payload-processing-e2e-ipp-b-a61855" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-69c9d6c8ff-rqscf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-584c5df55-df5nf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c5bf9a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c5bf9a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-351fd1: serviceaccount "payload-processing-e2e-ipp-b-351fd1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-351fd1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-351fd1-cbb8c8f76 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-351fd1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-351fd1: serviceaccount "payload-processing-e2e-ipp-b-351fd1" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

Unhealthy

Startup probe failed: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

ProbeError

Startup probe error: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5e71c9-9599987c4-z8zkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5e71c9-5f496fcf6c-mxhtw

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c5bf9a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c5bf9a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a61855-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a61855-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-319188-5db4ddbd87-hprl2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-319188-59f459b575-r26vz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-5e71c9-openshift-default-6b4bdcb695-n98bw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eebcb4-69df6b4bb4-26v6l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eebcb4-5fb98956c9-brvjj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-319188-59f459b575-r26vz

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.108:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5452c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5452c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

Unhealthy

Readiness probe failed: Get "http://10.134.0.113:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

ProbeError

Readiness probe error: Get "http://10.134.0.113:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c14e2-6b97c6f9f9-f94df

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c14e2-5cb65d4778-8k9lp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-eebcb4-openshift-default-74d678989-7skb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c5bf9a-68bfb9d64d-cvvln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c5bf9a-f6dbb66c5-cdbmj

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-7c14e2-openshift-default-68fdcfcc6c-kpkqz

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-319188-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-319188-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5452c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5452c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-319188-openshift-default-5bb45bd965-n24w5

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-351fd1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-351fd1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-c5bf9a-openshift-default-565dcfdd97-8srpx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-2b7ca7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-2b7ca7

openshift-ingress

deployment-controller

e2e-praxis-a-2b7ca7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c

SuccessfulCreate

Created pod: e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a61855-6c677847-tl98c

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a61855-59c8f6c6dd-xlrrx

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-2b7ca7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2b7ca7: serviceaccount "payload-processing-e2e-praxis-a-2b7ca7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2b7ca7: serviceaccount "payload-processing-e2e-praxis-a-2b7ca7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-2b7ca7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-5452c3-798c5694b9-4qwj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5452c3-58d4d7f4cf-9dfvm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a61855-openshift-default-8596696d9c-dv7rn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-38c5ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf

SuccessfulCreate

Created pod: e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-38c5ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-38c5ca

openshift-ingress

multus

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-351fd1-b755dbb5f-fnf4g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-351fd1-cbb8c8f76-bfjzz

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w4-53aa47-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-53aa47-openshift-default-9cbf98959 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-53aa47-openshift-default-9cbf98959

SuccessfulDelete

Deleted pod: e2e-worker-w4-53aa47-openshift-default-9cbf98959-bsp9q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-38c5ca-659c76c7df

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-38c5ca-659c76c7df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-38c5ca: serviceaccount "payload-processing-e2e-praxis-a-38c5ca" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-38c5ca-659c76c7df

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-38c5ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-38c5ca-659c76c7df from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-38c5ca: serviceaccount "payload-processing-e2e-praxis-a-38c5ca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-38c5ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c72dc9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c72dc9

openshift-ingress

replicaset-controller

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949

SuccessfulCreate

Created pod: e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

openshift-ingress

deployment-controller

e2e-praxis-a-c72dc9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c72dc9-openshift-default-5b99fdc949 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-351fd1-openshift-default-74f5c98f57-7vsws

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-w6qrs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-t686m

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-gpqhx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 10 to 7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c72dc9: serviceaccount "payload-processing-e2e-praxis-a-c72dc9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c72dc9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c72dc9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c72dc9-66757c7c7f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-n9gcx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-jmjqb

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c72dc9: serviceaccount "payload-processing-e2e-praxis-a-c72dc9" not found

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-42rg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-5452c3-openshift-default-7bcf44b967-z8chn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-955eb7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-955eb7

openshift-ingress

deployment-controller

e2e-ipp-a-955eb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-955eb7-openshift-default-9b68488fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-955eb7-openshift-default-9b68488fc

SuccessfulCreate

Created pod: e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

openshift-ingress

multus

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-xrf6j

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-pl2cz

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-t8zxd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-955eb7-df97b6dc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-955eb7-df97b6dc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-955eb7: serviceaccount "payload-processing-e2e-ipp-a-955eb7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-955eb7: serviceaccount "payload-processing-e2e-ipp-a-955eb7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-955eb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-955eb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-955eb7-df97b6dc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-955eb7-df97b6dc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-70cf03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-70cf03

openshift-ingress

multus

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-70cf03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-70cf03-openshift-default-67886c6f97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-70cf03-openshift-default-67886c6f97

SuccessfulCreate

Created pod: e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

openshift-ingress

multus

payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-praxis-b-99b00f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-99b00f-openshift-default-7767c9868f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-99b00f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-99b00f

openshift-ingress

replicaset-controller

e2e-praxis-b-99b00f-openshift-default-7767c9868f

SuccessfulCreate

Created pod: e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

openshift-ingress

multus

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-70cf03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-70cf03-76b94589f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-70cf03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-70cf03-56c58948c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-70cf03: serviceaccount "payload-processing-e2e-praxis-b-70cf03" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-70cf03-76b94589f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-70cf03-76b94589f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-70cf03: serviceaccount "payload-processing-e2e-praxis-b-70cf03" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-70cf03-76b94589f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-99b00f-8685b9b56f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-99b00f-775b484799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-b46w9

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-kn8s8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 10 to 8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-99b00f-775b484799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-99b00f-775b484799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-99b00f: serviceaccount "payload-processing-e2e-praxis-b-99b00f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-99b00f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-99b00f-8685b9b56f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-99b00f-8685b9b56f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-99b00f-8685b9b56f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-99b00f: serviceaccount "payload-processing-e2e-praxis-b-99b00f" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-99b00f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-99b00f-775b484799 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

ProbeError

Startup probe error: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

Unhealthy

Startup probe failed: Get "http://10.134.0.125:15021/healthz/ready": dial tcp 10.134.0.125:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

Started

Container started

openshift-ingress

replicaset-controller

e2e-ipp-a-b46fb7-openshift-default-99ccd7957

SuccessfulCreate

Created pod: e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b46fb7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b46fb7

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-6c1acd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-6c1acd

openshift-ingress

deployment-controller

e2e-ipp-a-b46fb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b46fb7-openshift-default-99ccd7957 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-6c1acd-openshift-default-7d464959bf

SuccessfulCreate

Created pod: e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

openshift-ingress

multus

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-6c1acd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-6c1acd-openshift-default-7d464959bf from 0 to 1

openshift-ingress

multus

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 7 to 6
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38c5ca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38c5ca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-z5lm5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-6c1acd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-6c1acd: serviceaccount "payload-processing-e2e-praxis-b-6c1acd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-6c1acd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-6c1acd-5fc758cf89 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-6c1acd: serviceaccount "payload-processing-e2e-praxis-b-6c1acd" not found
(x6)

openshift-ingress

kubelet

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b46fb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b46fb7: serviceaccount "payload-processing-e2e-ipp-a-b46fb7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b46fb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b46fb7: serviceaccount "payload-processing-e2e-ipp-a-b46fb7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-5bd564fc7f-4hnrd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-df97b6dc9-bn4cx

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99b00f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99b00f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

ProbeError

Readiness probe error: Get "http://10.133.0.116:15021/healthz/ready": read tcp 10.133.0.2:46594->10.133.0.116:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Unhealthy

Readiness probe failed: Get "http://10.133.0.116:15021/healthz/ready": read tcp 10.133.0.2:46594->10.133.0.116:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 8 to 7
(x2)

openshift-ingress

kubelet

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-26f77
(x2)

openshift-ingress

kubelet

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-955eb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-955eb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-955eb7-78b55758fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-955eb7: serviceaccount "payload-processing-e2e-ipp-a-955eb7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-955eb7-78b55758fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-955eb7-78b55758fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-955eb7-78b55758fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-955eb7: serviceaccount "payload-processing-e2e-ipp-a-955eb7" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-955eb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-955eb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2b7ca7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2b7ca7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-70cf03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-70cf03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b46fb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b46fb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

ProbeError

Startup probe error: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

Unhealthy

Startup probe failed: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2b7ca7-84d5cc7bc-hqnwz

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38c5ca-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-38c5ca-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2b7ca7-6569654dff-8gvz8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-38c5ca-78b9ffd675-lpk4b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-38c5ca-659c76c7df-bp65h

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-b80638-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b80638-openshift-default-66884b6f5f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-b80638-openshift-default-66884b6f5f

SuccessfulCreate

Created pod: e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b80638

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b80638

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5c665fd7ff-rh66b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-7bbb764d6c-pzmng

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b80638: serviceaccount "payload-processing-e2e-ipp-b-b80638" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b80638

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b80638-6944d5b6bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b80638-6944d5b6bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b80638

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b80638-6944d5b6bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b80638-6944d5b6bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b80638: serviceaccount "payload-processing-e2e-ipp-b-b80638" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c72dc9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c72dc9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c72dc9-66757c7c7f-drxrh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c72dc9-67b8c59867-hk4mz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b46fb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b46fb7: serviceaccount "payload-processing-e2e-ipp-a-b46fb7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b46fb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b46fb7-8d79db7c6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b46fb7: serviceaccount "payload-processing-e2e-ipp-a-b46fb7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-955eb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-955eb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48
(x7)

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-2b7ca7-openshift-default-5cf454c79c-qfs6m

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-38c5ca-openshift-default-7fcd849fdf-svdlb

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-70cf03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-70cf03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-70cf03-56c58948c-fclqr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-70cf03-76b94589f-sgf9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-praxis-a-c72dc9-openshift-default-5b99fdc949-ghzjt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7c7768

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7c7768

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-99b00f-775b484799-qvhvw

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-7c7768-openshift-default-6576b8554f

SuccessfulCreate

Created pod: e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

openshift-ingress

deployment-controller

e2e-ipp-b-7c7768-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7c7768-openshift-default-6576b8554f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-99b00f-8685b9b56f-9zlkt

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-5948d6f78c-2twt6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-6944d5b6bf-rqphw

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b46fb7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b46fb7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99b00f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-99b00f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6c1acd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-6c1acd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7c7768: serviceaccount "payload-processing-e2e-ipp-b-7c7768" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7c7768-66557bc9ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7c7768-66557bc9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7c7768: serviceaccount "payload-processing-e2e-ipp-b-7c7768" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7c7768-66557bc9ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7c7768

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7c7768-66557bc9ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7c7768

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-6c1acd-5f95894d95-drkcv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-6c1acd-5fc758cf89-rz9q9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-70cf03-openshift-default-67886c6f97-bhqq2

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b80638: serviceaccount "payload-processing-e2e-ipp-b-b80638" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b80638

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b80638-567fddf986 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b80638-567fddf986

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b80638-567fddf986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b80638: serviceaccount "payload-processing-e2e-ipp-b-b80638" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b80638-567fddf986

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b80638

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-99b00f-openshift-default-7767c9868f-sss74

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b80638-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b80638-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

ProbeError

Readiness probe error: Get "http://10.134.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-6c1acd-openshift-default-7d464959bf-2nfzx

Unhealthy

Readiness probe failed: Get "http://10.134.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-66557bc9ff-fstkf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-7bc76854cf-nbd5v

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7c7768-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7c7768-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-7pzkt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-7pzkt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7c7768: serviceaccount "payload-processing-e2e-ipp-b-7c7768" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7c7768

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7c7768-7c46496cdd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7c7768-7c46496cdd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7c7768-7c46496cdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7c7768: serviceaccount "payload-processing-e2e-ipp-b-7c7768" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7c7768

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7c7768-7c46496cdd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b80638-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-b80638-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

Unhealthy

Readiness probe failed: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

ProbeError

Readiness probe error: Get "http://10.133.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

Unhealthy

Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

ProbeError

Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

ProbeError

Startup probe error: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

Unhealthy

Startup probe failed: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-955eb7-656c7cf559-vcxmz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-955eb7-78b55758fb-cnj4g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 7 to 10
(x4)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes
(x4)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-955eb7-openshift-default-9b68488fc-66gxm

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7c7768-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7c7768-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x6)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

Started

Container started

openshift-ingress

multus

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": dial tcp 10.134.0.176:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

ProbeError

Startup probe error: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Unhealthy

Startup probe failed: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b80638-567fddf986-fgmdm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b80638-7457cd58d7-fgs2w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-117ee1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-117ee1

openshift-ingress

deployment-controller

e2e-praxis-a-117ee1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-117ee1-openshift-default-79d78bbff7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-117ee1-openshift-default-79d78bbff7

SuccessfulCreate

Created pod: e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-b80638-openshift-default-66884b6f5f-2k85m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

ProbeError

Readiness probe error: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

ProbeError

Readiness probe error: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Unhealthy

Readiness probe failed: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Unhealthy

Readiness probe failed: Get "http://10.134.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

AddedInterface

Add eth0 [10.134.0.178/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-117ee1: serviceaccount "payload-processing-e2e-praxis-a-117ee1" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-117ee1-84f85f57c5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-117ee1-84f85f57c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-117ee1: serviceaccount "payload-processing-e2e-praxis-a-117ee1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-117ee1-84f85f57c5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv

openshift-ingress

multus

payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-117ee1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-117ee1-84f85f57c5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-117ee1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-fa48f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-fa48f3

openshift-ingress

deployment-controller

e2e-praxis-b-fa48f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c

SuccessfulCreate

Created pod: e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

openshift-ingress

multus

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-117ee1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-117ee1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-fa48f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fa48f3: serviceaccount "payload-processing-e2e-praxis-b-fa48f3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-fa48f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fa48f3: serviceaccount "payload-processing-e2e-praxis-b-fa48f3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-176db5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-176db5

openshift-ingress

replicaset-controller

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765

SuccessfulCreate

Created pod: e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc

openshift-ingress

deployment-controller

e2e-shared-a-w2-176db5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-176db5-openshift-default-76d7ddc765 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-176db5: serviceaccount "payload-processing-e2e-shared-a-w2-176db5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-176db5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-176db5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-176db5-6ff4d88787 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-176db5: serviceaccount "payload-processing-e2e-shared-a-w2-176db5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-8fa15b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-8fa15b

openshift-ingress

multus

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647

SuccessfulCreate

Created pod: e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

openshift-ingress

deployment-controller

e2e-shared-a-w3-8fa15b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

Unhealthy

Startup probe failed: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

ProbeError

Startup probe error: Get "http://10.134.0.178:15021/healthz/ready": dial tcp 10.134.0.178:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-8fa15b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-8fa15b-c5f767997 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8fa15b: serviceaccount "payload-processing-e2e-shared-a-w3-8fa15b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-8fa15b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8fa15b: serviceaccount "payload-processing-e2e-shared-a-w3-8fa15b" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

Unhealthy

Readiness probe failed: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

ProbeError

Readiness probe error: Get "http://10.133.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-e53c37

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-e53c37

openshift-ingress

replicaset-controller

e2e-shared-a-w1-e53c37-openshift-default-84d754496f

SuccessfulCreate

Created pod: e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

openshift-ingress

multus

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w1-e53c37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-e53c37-openshift-default-84d754496f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-74f9f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-74f9f4

openshift-ingress

deployment-controller

e2e-shared-b-w2-74f9f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997

SuccessfulCreate

Created pod: e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

openshift-ingress

multus

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-e53c37

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-e53c37: serviceaccount "payload-processing-e2e-shared-a-w1-e53c37" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-e53c37: serviceaccount "payload-processing-e2e-shared-a-w1-e53c37" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-e53c37

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-74f9f4: serviceaccount "payload-processing-e2e-shared-b-w2-74f9f4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-74f9f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Unhealthy

Readiness probe failed: Get "http://10.134.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

ProbeError

Readiness probe error: Get "http://10.134.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-74f9f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-74f9f4: serviceaccount "payload-processing-e2e-shared-b-w2-74f9f4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-117ee1-84f85f57c5-h9xq6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-117ee1-7f4b7c479f-cnhzv

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fa48f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fa48f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-117ee1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-117ee1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Unhealthy

Startup probe failed: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

ProbeError

Startup probe error: Get "http://10.134.0.184:15021/healthz/ready": dial tcp 10.134.0.184:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-b46fb7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-b46fb7-openshift-default-99ccd7957

SuccessfulCreate

Created pod: e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-b46fb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b46fb7-openshift-default-99ccd7957 from 1 to 2

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Unhealthy

Readiness probe failed: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-117ee1-openshift-default-79d78bbff7-tg64g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

ProbeError

Readiness probe error: Get "http://10.134.0.172:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

ProbeError

Startup probe error: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

Unhealthy

Startup probe failed: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fa48f3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fa48f3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7

SuccessfulCreate

Created pod: e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

openshift-ingress

deployment-controller

e2e-shared-b-w3-f64640-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-f64640-openshift-default-d945bfdb7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-f64640

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f64640

openshift-ingress

multus

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fa48f3-c5f9f5c7f-lx8tc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fa48f3-5d4c4445d9-njphx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-321ccd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-321ccd
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-8fa15b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w3-8fa15b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647

SuccessfulCreate

Created pod: e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

openshift-ingress

multus

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-f64640

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w1-321ccd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f64640: serviceaccount "payload-processing-e2e-shared-b-w3-f64640" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f64640-6f868446cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-f64640-6f868446cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f64640: serviceaccount "payload-processing-e2e-shared-b-w3-f64640" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7

SuccessfulCreate

Created pod: e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-f64640

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-f64640-6f868446cc from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f64640-6f868446cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

Started

Container started

openshift-ingress

multus

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

Unhealthy

Startup probe failed: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

ProbeError

Startup probe error: Get "http://10.134.0.186:15021/healthz/ready": dial tcp 10.134.0.186:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-321ccd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-321ccd: serviceaccount "payload-processing-e2e-shared-b-w1-321ccd" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b46fb7-8d79db7c6-c9s48

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-321ccd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-321ccd: serviceaccount "payload-processing-e2e-shared-b-w1-321ccd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b46fb7-5577bf5499-cdvwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-176db5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-176db5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-fa48f3-openshift-default-55fbd96d9c-7ll6f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-3a65ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-3a65ec-openshift-default-9f9996889 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-3a65ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-3a65ec

openshift-ingress

replicaset-controller

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889

SuccessfulCreate

Created pod: e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

openshift-ingress

multus

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-f64640-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3a65ec: serviceaccount "payload-processing-e2e-shared-a-w0-3a65ec" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-3a65ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-3a65ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-f64640-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-3a65ec: serviceaccount "payload-processing-e2e-shared-a-w0-3a65ec" not found
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e53c37-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e53c37-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-74f9f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-74f9f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-8fa15b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-8fa15b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-mfvmc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 9 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-mfvmc

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 6 to 5

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-bkg5n

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

Unhealthy

Readiness probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

ProbeError

Readiness probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-a50675

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-a50675
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

Unhealthy

Startup probe failed: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

ProbeError

Startup probe error: Get "http://10.134.0.191:15021/healthz/ready": dial tcp 10.134.0.191:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w0-a50675-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-a50675-openshift-default-85dcc5678f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f

SuccessfulCreate

Created pod: e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e53c37-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e53c37-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

AddedInterface

Add eth0 [10.134.0.195/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-a50675: serviceaccount "payload-processing-e2e-shared-b-w0-a50675" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-a50675

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-mk259

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-b46fb7-openshift-default-99ccd7957-s4xnr

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-a50675: serviceaccount "payload-processing-e2e-shared-b-w0-a50675" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-a50675

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-321ccd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-321ccd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7c7768-5bcb6cb7f5-b5nlq

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-74f9f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7c7768-7c46496cdd-bg755

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-74f9f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-321ccd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-321ccd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-89d993-openshift-default-665f5486f7

SuccessfulCreate

Created pod: e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-89d993

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-89d993

openshift-ingress

deployment-controller

e2e-praxis-a-89d993-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-89d993-openshift-default-665f5486f7 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a50675-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a50675-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-f64640-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-f64640-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-7c7768-openshift-default-6576b8554f-7vtq6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-89d993

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-89d993-775594f7d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-89d993-c6c97799f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-89d993-c6c97799f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-89d993-c6c97799f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-89d993: serviceaccount "payload-processing-e2e-praxis-a-89d993" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-89d993

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-89d993-c6c97799f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-89d993: serviceaccount "payload-processing-e2e-praxis-a-89d993" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w1-e53c37-openshift-default-84d754496f

SuccessfulCreate

Created pod: e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

openshift-ingress

deployment-controller

e2e-shared-a-w1-e53c37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-e53c37-openshift-default-84d754496f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e53c37-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

ProbeError

Startup probe error: Get "http://10.134.0.202:15021/healthz/ready": dial tcp 10.134.0.202:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

Unhealthy

Startup probe failed: Get "http://10.134.0.202:15021/healthz/ready": dial tcp 10.134.0.202:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-3a65ec-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-3a65ec-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

ProbeError

Startup probe error: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

Unhealthy

Startup probe failed: Get "http://10.134.0.195:15021/healthz/ready": dial tcp 10.134.0.195:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-49c7c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-49c7c2

openshift-ingress

deployment-controller

e2e-praxis-b-49c7c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf

SuccessfulCreate

Created pod: e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

openshift-ingress

multus

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-321ccd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w1-321ccd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7

SuccessfulCreate

Created pod: e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

openshift-ingress

multus

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-49c7c2: serviceaccount "payload-processing-e2e-praxis-b-49c7c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-49c7c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-49c7c2: serviceaccount "payload-processing-e2e-praxis-b-49c7c2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-49c7c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

Unhealthy

Readiness probe failed: Get "http://10.134.0.197:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

ProbeError

Readiness probe error: Get "http://10.134.0.197:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

Unhealthy

Startup probe failed: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

ProbeError

Startup probe error: Get "http://10.134.0.197:15021/healthz/ready": dial tcp 10.134.0.197:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-89d993-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-89d993-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a50675-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a50675-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 8 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-cwl6l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-cwl6l

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-l4bs2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-89d993-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-89d993-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-49c7c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w2-74f9f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-74f9f4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997

SuccessfulCreate

Created pod: e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-49c7c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

Unhealthy

Startup probe failed: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

ProbeError

Startup probe error: Get "http://10.134.0.205:15021/healthz/ready": dial tcp 10.134.0.205:15021: connect: connection refused body:

opendatahub

multus

test-curl-7609-b45643

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-b45643

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7609-b45643

Created

Container created

opendatahub

kubelet

test-curl-7609-b45643

Started

Container started

opendatahub

kubelet

test-curl-7609-8b05dd

Started

Container started

opendatahub

kubelet

test-curl-7609-8b05dd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7609-8b05dd

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-b45643

Killing

Stopping container test-curl-7609-b45643

opendatahub

kubelet

test-curl-7609-8b05dd

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-49c7c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-49c7c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7609-703e17

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7609-703e17

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-703e17

Started

Container started

opendatahub

kubelet

test-curl-7609-8b05dd

Killing

Stopping container test-curl-7609-8b05dd

opendatahub

kubelet

test-curl-7609-703e17

Created

Container created

opendatahub

multus

test-curl-7609-626c35

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-626c35

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7609-626c35

Started

Container started

opendatahub

kubelet

test-curl-7609-626c35

Created

Container created

opendatahub

kubelet

test-curl-7609-703e17

Killing

Stopping container test-curl-7609-703e17

opendatahub

kubelet

test-curl-7609-4453f0

Started

Container started

opendatahub

multus

test-curl-7609-4453f0

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-626c35

Killing

Stopping container test-curl-7609-626c35

opendatahub

kubelet

test-curl-7609-4453f0

Created

Container created

opendatahub

kubelet

test-curl-7609-4453f0

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7609-72666a

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-72666a

Created

Container created

opendatahub

kubelet

test-curl-7609-72666a

Started

Container started

opendatahub

kubelet

test-curl-7609-4453f0

Killing

Stopping container test-curl-7609-4453f0

opendatahub

kubelet

test-curl-7609-72666a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7609-72666a

Killing

Stopping container test-curl-7609-72666a

openshift-ingress

deployment-controller

e2e-extmod-a-345bc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-345bc4-openshift-default-c59dc5c89 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-345bc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-345bc4

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-345bc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-345bc4-7555945897

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-345bc4-7555945897-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-345bc4: serviceaccount "payload-processing-e2e-extmod-a-345bc4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-345bc4-7555945897

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-345bc4-7555945897-88pml

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-345bc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-345bc4-7555945897 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-345bc4: serviceaccount "payload-processing-e2e-extmod-a-345bc4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-345bc4-7555945897-88pml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-345bc4-7555945897-88pml

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-345bc4-7555945897-88pml

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-345bc4-7555945897-88pml

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-fmxnm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 10 to 7
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-nmq25

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-xmsg5

openshift-ingress

replicaset-controller

e2e-extmod-b-a574c2-openshift-default-5c5f754885

SuccessfulCreate

Created pod: e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

openshift-ingress

deployment-controller

e2e-extmod-b-a574c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a574c2-openshift-default-5c5f754885 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-a574c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-a574c2

openshift-ingress

multus

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a574c2-5b8867994f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a574c2: serviceaccount "payload-processing-e2e-extmod-b-a574c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-a574c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-a574c2-5b8867994f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-a574c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-a574c2-5b8867994f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-a574c2-5b8867994f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-a574c2: serviceaccount "payload-processing-e2e-extmod-b-a574c2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-praxis-a-89d993-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-89d993-openshift-default-665f5486f7 from 1 to 2

openshift-ingress

multus

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-89d993-openshift-default-665f5486f7

SuccessfulCreate

Created pod: e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-89d993-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-noten-6538cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6538cc-openshift-default-6f4b9959b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-6538cc-openshift-default-6f4b9959b5

SuccessfulCreate

Created pod: e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

openshift-ingress

gateway_labeler_controller

e2e-noten-6538cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6538cc
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-89d993-775594f7d7-b6dpc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

Started

Container started

openshift-ingress

kubelet

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

Created

Container created

openshift-ingress

kubelet

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-89d993-c6c97799f-hhx72

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-99668e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-99668e

openshift-ingress

deployment-controller

e2e-extmod-a-99668e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-99668e-openshift-default-67c7577f5c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-99668e-openshift-default-67c7577f5c

SuccessfulCreate

Created pod: e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

openshift-ingress

multus

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7603-0f8dd3

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused

opendatahub

kubelet

test-curl-7603-0f8dd3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7603-0f8dd3

Created

Container created

opendatahub

multus

test-curl-7603-0f8dd3

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7603-0f8dd3

Killing

Stopping container test-curl-7603-0f8dd3

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-99668e-79c94cc98f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-99668e-79c94cc98f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-99668e: serviceaccount "payload-processing-e2e-extmod-a-99668e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-99668e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-99668e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-99668e-79c94cc98f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-99668e: serviceaccount "payload-processing-e2e-extmod-a-99668e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-99668e-79c94cc98f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

openshift-ingress

multus

payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-6538cc-openshift-default-6f4b9959b5-kq47c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 10 to 7
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-nwthk

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-78skt

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-tw7fp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f

SuccessfulCreate

Created pod: e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-a50675-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w0-a50675-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-a50675-openshift-default-85dcc5678f from 1 to 2

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

Created

Container created

openshift-ingress

multus

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-ncjdn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-4bq6r

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-autores-435414

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-435414
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

Unhealthy

Startup probe failed: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

ProbeError

Startup probe error: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-autores-435414-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-435414-openshift-default-7b78b47f57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-435414-openshift-default-7b78b47f57

SuccessfulCreate

Created pod: e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

openshift-ingress

multus

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

ProbeError

Startup probe error: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

Unhealthy

Startup probe failed: Get "http://10.134.0.206:15021/healthz/ready": dial tcp 10.134.0.206:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-435414-6f9b5df87

SuccessfulCreate

Created pod: payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

openshift-ingress

deployment-controller

payload-processing-e2e-autores-435414

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-435414-6f9b5df87 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-435414-6f9b5df87

FailedCreate

Error creating: pods "payload-processing-e2e-autores-435414-6f9b5df87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-435414: serviceaccount "payload-processing-e2e-autores-435414" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-435414

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-435414-5bf8cdfd95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-435414-5bf8cdfd95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-435414-5bf8cdfd95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-435414-5bf8cdfd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-435414: serviceaccount "payload-processing-e2e-autores-435414" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-e07442

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-e07442

openshift-ingress

replicaset-controller

e2e-extmod-b-e07442-openshift-default-56d77688d5

SuccessfulCreate

Created pod: e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

openshift-ingress

deployment-controller

e2e-extmod-b-e07442-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e07442-openshift-default-56d77688d5 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-2h8ll

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dg59p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e07442-8f78fbd57

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a574c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-e07442

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-e07442-8f78fbd57 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e07442-8f78fbd57

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-e07442-8f78fbd57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e07442: serviceaccount "payload-processing-e2e-extmod-b-e07442" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a574c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-e07442

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e07442: serviceaccount "payload-processing-e2e-extmod-b-e07442" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

openshift-ingress

multus

payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2h8ll

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x2xs6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-p8jx9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-89d993-openshift-default-665f5486f7-x5hgs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-6741b1-openshift-default-5954d7485c

SuccessfulCreate

Created pod: e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

openshift-ingress

deployment-controller

e2e-extmod-a-6741b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6741b1-openshift-default-5954d7485c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6741b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6741b1

openshift-ingress

multus

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a574c2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6741b1: serviceaccount "payload-processing-e2e-extmod-a-6741b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a574c2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6741b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6741b1-6c786b975c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6741b1-6c786b975c

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6741b1-6c786b975c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6741b1: serviceaccount "payload-processing-e2e-extmod-a-6741b1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6741b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6741b1-6c786b975c

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv

Created

Container created
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 4 to 3

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-69c84

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-49c7c2-6f8cd548bf-mqw2l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-49c7c2-55f9895595-5mh2z

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

ProbeError

Startup probe error: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

Unhealthy

Startup probe failed: Get "http://10.134.0.210:15021/healthz/ready": dial tcp 10.134.0.210:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-99668e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-99668e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-explicit-7386b4-openshift-default-86696945cc

SuccessfulCreate

Created pod: e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

openshift-ingress

kubelet

e2e-praxis-b-49c7c2-openshift-default-6c7f896fdf-gvlrb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-7386b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7386b4-openshift-default-86696945cc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-7386b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7386b4

openshift-ingress

multus

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-e07442-openshift-default-56d77688d5

SuccessfulCreate

Created pod: e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

openshift-ingress

replicaset-controller

e2e-extmod-b-e07442-openshift-default-56d77688d5

SuccessfulCreate

Created pod: e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-e07442-openshift-default-56d77688d5

SuccessfulCreate

Created pod: e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

openshift-ingress

deployment-controller

e2e-extmod-b-e07442-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e07442-openshift-default-56d77688d5 from 1 to 4

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

Created

Container created

openshift-ingress

multus

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

Started

Container started

openshift-ingress

multus

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-99668e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

Unhealthy

Readiness probe failed: Get "http://10.134.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

ProbeError

Readiness probe error: Get "http://10.134.0.214:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7386b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7386b4-69d55df66c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7386b4-69d55df66c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7386b4-69d55df66c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7386b4-69d55df66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7386b4: serviceaccount "payload-processing-e2e-explicit-7386b4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7386b4-5d77f9646f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7386b4-5d77f9646f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7386b4-5d77f9646f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7386b4: serviceaccount "payload-processing-e2e-explicit-7386b4" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-99668e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7386b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7386b4-5d77f9646f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

Unhealthy

Startup probe failed: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

ProbeError

Startup probe error: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-435414-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-435414-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

ProbeError

Startup probe error: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

Unhealthy

Startup probe failed: Get "http://10.134.0.219:15021/healthz/ready": dial tcp 10.134.0.219:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

Unhealthy

Startup probe failed: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

ProbeError

Startup probe error: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

Unhealthy

Startup probe failed: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

ProbeError

Startup probe error: Get "http://10.134.0.214:15021/healthz/ready": dial tcp 10.134.0.214:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-d95261

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-d95261

openshift-ingress

deployment-controller

e2e-extmod-b-d95261-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d95261-openshift-default-664cbbcc4f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-d95261-openshift-default-664cbbcc4f

SuccessfulCreate

Created pod: e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

openshift-ingress

multus

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-d95261

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d95261: serviceaccount "payload-processing-e2e-extmod-b-d95261" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d95261-69665dc795

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-d95261-69665dc795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d95261: serviceaccount "payload-processing-e2e-extmod-b-d95261" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d95261-69665dc795

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-d95261

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-d95261-69665dc795 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-435414-5bf8cdfd95-brtbh

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.213:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-autores-435414-6f9b5df87-kwdfk

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.229:50052" within 1s: context deadline exceeded

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

ProbeError

Readiness probe error: Get "http://10.134.0.216:15021/healthz/ready": read tcp 10.134.0.2:48860->10.134.0.216:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

Unhealthy

Readiness probe failed: Get "http://10.134.0.216:15021/healthz/ready": read tcp 10.134.0.2:48860->10.134.0.216:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-435414-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-435414-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-9755k

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7

SuccessfulCreate

Created pod: e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

openshift-ingress

deployment-controller

e2e-extmod-a-e8063c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-e8063c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-e8063c
(x6)

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

ProbeError

Startup probe error: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

Unhealthy

Startup probe failed: Get "http://10.134.0.216:15021/healthz/ready": dial tcp 10.134.0.216:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-435414-openshift-default-7b78b47f57-9lbtj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6741b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6741b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-e8063c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-e8063c-749c5dc57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e8063c-749c5dc57

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e8063c-749c5dc57

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-e8063c-749c5dc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e8063c: serviceaccount "payload-processing-e2e-extmod-a-e8063c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e8063c: serviceaccount "payload-processing-e2e-extmod-a-e8063c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-e8063c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8063c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8063c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6741b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6741b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

Unhealthy

Readiness probe failed: Get "http://10.134.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

ProbeError

Readiness probe error: Get "http://10.134.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7386b4-69d55df66c-ftfdp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7386b4-5d77f9646f-jgf2n

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

Unhealthy

Startup probe failed: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

ProbeError

Startup probe error: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-7386b4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-7386b4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

ProbeError

Readiness probe error: Get "http://10.134.0.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

Unhealthy

Readiness probe failed: Get "http://10.134.0.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc

SuccessfulCreate

Created pod: e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

openshift-ingress

deployment-controller

e2e-extmod-b-e1e0f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-e1e0f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-e1e0f5

openshift-ingress

multus

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

Created

Container created

openshift-ingress

kubelet

e2e-explicit-7386b4-openshift-default-86696945cc-hbp6k

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e1e0f5: serviceaccount "payload-processing-e2e-extmod-b-e1e0f5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-e1e0f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-e1e0f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e1e0f5: serviceaccount "payload-processing-e2e-extmod-b-e1e0f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-a-00909f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-00909f-openshift-default-7c565998f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-00909f-openshift-default-7c565998f7

SuccessfulCreate

Created pod: e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-00909f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-00909f

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

AddedInterface

Add eth0 [10.132.0.246/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

Unhealthy

Startup probe failed: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

ProbeError

Startup probe error: Get "http://10.134.0.221:15021/healthz/ready": dial tcp 10.134.0.221:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-00909f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-00909f-64695dc5f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-00909f-64695dc5f5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-00909f-64695dc5f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-00909f: serviceaccount "payload-processing-e2e-extmod-a-00909f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-00909f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-00909f: serviceaccount "payload-processing-e2e-extmod-a-00909f" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

AddedInterface

Add eth0 [10.132.0.247/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-00909f-64695dc5f5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8063c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e8063c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-a574c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-a574c2-openshift-default-5c5f754885 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-a574c2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-a574c2-openshift-default-5c5f754885

SuccessfulCreate

Created pod: e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

Started

Container started

openshift-ingress

multus

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-f147de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-f147de

openshift-ingress

deployment-controller

e2e-extmod-b-f147de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-f147de-openshift-default-756bddc4df from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-f147de-openshift-default-756bddc4df

SuccessfulCreate

Created pod: e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

openshift-ingress

multus

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

AddedInterface

Add eth0 [10.134.0.225/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-f147de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f147de-659b45bcff

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-f147de-659b45bcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f147de: serviceaccount "payload-processing-e2e-extmod-b-f147de" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-f147de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-f147de-659b45bcff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f147de: serviceaccount "payload-processing-e2e-extmod-b-f147de" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f147de-659b45bcff

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-00909f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-00909f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

Unhealthy

Startup probe failed: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

ProbeError

Startup probe error: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

ProbeError

Startup probe error: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

Unhealthy

Startup probe failed: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1e0f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1e0f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

ProbeError

Readiness probe error: Get "http://10.133.0.153:15021/healthz/ready": read tcp 10.133.0.2:39294->10.133.0.153:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

Unhealthy

Readiness probe failed: Get "http://10.133.0.153:15021/healthz/ready": read tcp 10.133.0.2:39294->10.133.0.153:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

Unhealthy

Startup probe failed: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

ProbeError

Startup probe error: Get "http://10.133.0.153:15021/healthz/ready": dial tcp 10.133.0.153:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1e0f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1e0f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-00909f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-00909f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d95261-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d95261-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

Unhealthy

Startup probe failed: Get "http://10.134.0.225:15021/healthz/ready": dial tcp 10.134.0.225:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

ProbeError

Startup probe error: Get "http://10.134.0.225:15021/healthz/ready": dial tcp 10.134.0.225:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f147de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f147de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc

SuccessfulCreate

Created pod: e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

openshift-ingress

replicaset-controller

e2e-extmod-b-d95261-openshift-default-664cbbcc4f

SuccessfulCreate

Created pod: e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1e0f5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-e1e0f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d95261-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-d95261-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d95261-openshift-default-664cbbcc4f from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

Started

Container started

openshift-ingress

multus

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

AddedInterface

Add eth0 [10.134.0.227/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-00909f-openshift-default-7c565998f7

SuccessfulCreate

Created pod: e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

openshift-ingress

deployment-controller

e2e-extmod-a-00909f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-00909f-openshift-default-7c565998f7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-00909f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

Unhealthy

Startup probe failed: Get "http://10.134.0.228:15021/healthz/ready": dial tcp 10.134.0.228:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f147de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

ProbeError

Startup probe error: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

ProbeError

Startup probe error: Get "http://10.134.0.228:15021/healthz/ready": dial tcp 10.134.0.228:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f147de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

Unhealthy

Startup probe failed: Get "http://10.134.0.227:15021/healthz/ready": dial tcp 10.134.0.227:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-x6w6k

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-e07442-openshift-default-56d77688d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-m4zkb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-e07442-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-e07442-openshift-default-56d77688d5 from 4 to 3
(x2)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-345bc4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-345bc4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

AddedInterface

Add eth0 [10.132.1.39/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

AddedInterface

Add eth0 [10.134.0.229/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-345bc4-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-345bc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-345bc4-openshift-default-c59dc5c89 from 1 to 4

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

Unhealthy

Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

ProbeError

Startup probe error: Get "http://10.132.1.39:15021/healthz/ready": dial tcp 10.132.1.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

Unhealthy

Startup probe failed: Get "http://10.132.1.39:15021/healthz/ready": dial tcp 10.132.1.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

ProbeError

Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

Unhealthy

Startup probe failed: Get "http://10.134.0.229:15021/healthz/ready": dial tcp 10.134.0.229:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

ProbeError

Startup probe error: Get "http://10.134.0.229:15021/healthz/ready": dial tcp 10.134.0.229:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-345bc4-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-extmod-a-345bc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-345bc4-openshift-default-c59dc5c89 from 4 to 8

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

Created

Container created

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

AddedInterface

Add eth0 [10.132.1.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

Created

Container created

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

AddedInterface

Add eth0 [10.134.0.231/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

ProbeError

Startup probe error: Get "http://10.132.1.41:15021/healthz/ready": dial tcp 10.132.1.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

Unhealthy

Startup probe failed: Get "http://10.132.1.41:15021/healthz/ready": dial tcp 10.132.1.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

ProbeError

Startup probe error: Get "http://10.134.0.230:15021/healthz/ready": dial tcp 10.134.0.230:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

Unhealthy

Startup probe failed: Get "http://10.134.0.230:15021/healthz/ready": dial tcp 10.134.0.230:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

ProbeError

Startup probe error: Get "http://10.134.0.231:15021/healthz/ready": dial tcp 10.134.0.231:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

Unhealthy

Startup probe failed: Get "http://10.134.0.231:15021/healthz/ready": dial tcp 10.134.0.231:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulCreate

Created pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-345bc4-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

AddedInterface

Add eth0 [10.132.1.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-345bc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-345bc4-openshift-default-c59dc5c89 from 8 to 10

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

Started

Container started

openshift-ingress

multus

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

ProbeError

Startup probe error: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

Unhealthy

Startup probe failed: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

Unhealthy

Startup probe failed: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

ProbeError

Startup probe error: Get "http://10.132.1.43:15021/healthz/ready": dial tcp 10.132.1.43:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-59cd9876d5 from 0 to 1
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-59cd9876d5

FailedCreate

Error creating: pods "payload-processing-external-model-59cd9876d5-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-59cd9876d5-km8cr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-59cd9876d5-km8cr

Created

Container created

models-as-a-service

multus

payload-processing-external-model-59cd9876d5-km8cr

AddedInterface

Add eth0 [10.132.1.53/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-59cd9876d5

SuccessfulCreate

Created pod: payload-processing-external-model-59cd9876d5-km8cr

models-as-a-service

kubelet

payload-processing-external-model-59cd9876d5-km8cr

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-6494c5b757

SuccessfulCreate

Created pod: payload-processing-external-model-6494c5b757-s2z9w

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6494c5b757 from 0 to 1

models-as-a-service

multus

payload-processing-external-model-6494c5b757-s2z9w

AddedInterface

Add eth0 [10.132.1.60/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6494c5b757-s2z9w

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6494c5b757-s2z9w

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6494c5b757-s2z9w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6494c5b757 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-6b4fdd8ddc

SuccessfulCreate

Created pod: payload-processing-external-model-6b4fdd8ddc-ctw4d

models-as-a-service

replicaset-controller

payload-processing-external-model-6494c5b757

SuccessfulDelete

Deleted pod: payload-processing-external-model-6494c5b757-s2z9w

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b4fdd8ddc from 0 to 1

models-as-a-service

multus

payload-processing-external-model-6b4fdd8ddc-ctw4d

AddedInterface

Add eth0 [10.132.1.61/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6b4fdd8ddc-ctw4d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6b4fdd8ddc-ctw4d

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6b4fdd8ddc-ctw4d

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6494c5b757-s2z9w

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-59cd9876d5

SuccessfulDelete

Deleted pod: payload-processing-external-model-59cd9876d5-km8cr

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-59cd9876d5 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-59cd9876d5-km8cr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 6 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-9cqch

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-x6r22

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-x6r22

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-x6r22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-x6r22

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-9cqch

AddedInterface

Add eth0 [10.132.1.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-9cqch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-9cqch

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-x6r22

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-9cqch

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-9cqch

Unhealthy

Startup probe failed: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-x6r22

Unhealthy

Startup probe failed: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-x6r22

ProbeError

Startup probe error: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-9cqch

ProbeError

Startup probe error: Get "http://10.132.1.64:15021/healthz/ready": dial tcp 10.132.1.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 8 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-qbpx6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-xr9v5
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-qbpx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-xr9v5

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-qbpx6

AddedInterface

Add eth0 [10.134.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-qbpx6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-qbpx6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-qbpx6

ProbeError

Startup probe error: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-qbpx6

Unhealthy

Startup probe failed: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 7 to 5

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-2wvpw

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-hm2ln

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-wzld2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x15)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": context deadline exceeded

openshift-ingress

replicaset-controller

e2e-extmod-b-e07442-openshift-default-56d77688d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-e07442-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-e07442-openshift-default-56d77688d5 from 3 to 2

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-fx4qz

Killing

Stopping container istio-proxy

models-as-a-service

replicaset-controller

payload-processing-external-model-f7847d4fb

SuccessfulCreate

Created pod: payload-processing-external-model-f7847d4fb-xsn8q

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-f7847d4fb from 0 to 1

models-as-a-service

multus

payload-processing-external-model-f7847d4fb-xsn8q

AddedInterface

Add eth0 [10.132.1.68/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-f7847d4fb from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-f7847d4fb

SuccessfulDelete

Deleted pod: payload-processing-external-model-f7847d4fb-xsn8q

models-as-a-service

kubelet

payload-processing-external-model-f7847d4fb-xsn8q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-f7847d4fb-xsn8q

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-f7847d4fb-xsn8q

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-f7847d4fb-xsn8q

Killing

Stopping container payload-processing
(x4)

models-as-a-service

kubelet

payload-processing-external-model-f7847d4fb-xsn8q

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-0100150b71ea" not found

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulDelete

Deleted pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

openshift-ingress

deployment-controller

e2e-extmod-a-345bc4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-345bc4-openshift-default-c59dc5c89 from 10 to 8

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-sgx2h

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-345bc4-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulDelete

Deleted pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-2sp8v

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

Killing

Stopping container istio-proxy

models-as-a-service

replicaset-controller

payload-processing-external-model-9f8bd7d97

SuccessfulCreate

Created pod: payload-processing-external-model-9f8bd7d97-kfm4f

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-8e4acb-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-8e4acb-openshift-default-868dc48fff

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-8e4acb-openshift-default-868dc48fff-gtbz8

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-9f8bd7d97 from 0 to 1
(x4)

openshift-ingress

deployment-controller

e2e-worker-w2-8e4acb-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-8e4acb-openshift-default-868dc48fff from 4 to 3

models-as-a-service

kubelet

payload-processing-external-model-9f8bd7d97-kfm4f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-9f8bd7d97-kfm4f

AddedInterface

Add eth0 [10.132.1.80/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-9f8bd7d97-kfm4f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-53aa47-openshift-default-9cbf98959

SuccessfulDelete

Deleted pod: e2e-worker-w4-53aa47-openshift-default-9cbf98959-mk278

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-53aa47-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-53aa47-openshift-default-9cbf98959 from 3 to 2

models-as-a-service

kubelet

payload-processing-external-model-9f8bd7d97-kfm4f

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-nvxkd

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-9fzqw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulDelete

Deleted pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-345bc4-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-qqj4c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulDelete

Deleted pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-tv8dr

openshift-ingress

deployment-controller

e2e-extmod-a-345bc4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-345bc4-openshift-default-c59dc5c89 from 8 to 5

openshift-ingress

replicaset-controller

e2e-extmod-a-345bc4-openshift-default-c59dc5c89

SuccessfulDelete

Deleted pod: e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-4t9b8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-lj2z2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-8fa15b-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-xhhr8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-8fa15b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-bc102e-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f

SuccessfulDelete

Deleted pod: e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

models-as-a-service

replicaset-controller

payload-processing-external-model-6b4fdd8ddc

SuccessfulDelete

Deleted pod: payload-processing-external-model-6b4fdd8ddc-ctw4d

models-as-a-service

kubelet

payload-processing-external-model-6b4fdd8ddc-ctw4d

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6b4fdd8ddc from 1 to 0

openshift-ingress

deployment-controller

e2e-worker-w0-bc102e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-bc102e-openshift-default-6bfc9f987f from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-92x5g

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-v4rv2

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

replicaset-controller

payload-processing-external-model-ff5d646d

SuccessfulCreate

Created pod: payload-processing-external-model-ff5d646d-d5xlp

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled up replica set payload-processing-external-model-ff5d646d from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-ff5d646d-d5xlp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-ff5d646d-d5xlp

AddedInterface

Add eth0 [10.132.1.94/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-ff5d646d-d5xlp

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-ff5d646d-d5xlp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-9f8bd7d97-kfm4f

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-ff5d646d-d5xlp

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-external-model-dockercfg-sfdtt); attempting to pull the image may not succeed.

openshift-ingress

deployment-controller

e2e-inf-a-ddcf93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ddcf93-openshift-default-78f6598b5c from 0 to 1

openshift-ingress

multus

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

AddedInterface

Add eth0 [10.132.1.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-ddcf93-openshift-default-78f6598b5c

SuccessfulCreate

Created pod: e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ddcf93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ddcf93

models-as-a-service

kubelet

payload-processing-external-model-ff5d646d-d5xlp

Killing

Stopping container payload-processing
(x3)

models-as-a-service

kubelet

payload-processing-external-model-ff5d646d-d5xlp

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-external-model-plugins" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5757ff5f4d

SuccessfulCreate

Created pod: payload-processing-external-model-5757ff5f4d-kj29g
(x5)

models-as-a-service

replicaset-controller

payload-processing-external-model-5757ff5f4d

FailedCreate

Error creating: pods "payload-processing-external-model-5757ff5f4d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5757ff5f4d from 0 to 1
(x4)

models-as-a-service

kubelet

payload-processing-external-model-ff5d646d-d5xlp

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-b4eff0c43a87" not found

models-as-a-service

multus

payload-processing-external-model-5757ff5f4d-kj29g

AddedInterface

Add eth0 [10.132.1.98/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-kj29g

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-kj29g

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-kj29g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ddcf93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ddcf93-75fd559bb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ddcf93: serviceaccount "payload-processing-e2e-inf-a-ddcf93" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ddcf93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ddcf93-75fd559bb7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ddcf93-75fd559bb7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ddcf93-75fd559bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ddcf93: serviceaccount "payload-processing-e2e-inf-a-ddcf93" not found

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-kj29g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24

AddedInterface

Add eth0 [10.132.1.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

AddedInterface

Add eth0 [10.132.1.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5757ff5f4d from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5757ff5f4d

SuccessfulCreate

Created pod: payload-processing-external-model-5757ff5f4d-bfhxj
(x7)

models-as-a-service

replicaset-controller

payload-processing-external-model-5757ff5f4d

FailedCreate

Error creating: pods "payload-processing-external-model-5757ff5f4d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

openshift-ingress

deployment-controller

e2e-inf-a-ffce13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ffce13-openshift-default-745589f55f from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-bfhxj

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-a-ffce13-openshift-default-745589f55f

SuccessfulCreate

Created pod: e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

models-as-a-service

multus

payload-processing-external-model-5757ff5f4d-bfhxj

AddedInterface

Add eth0 [10.132.1.104/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-bfhxj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-bfhxj

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ffce13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ffce13

openshift-ingress

multus

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5757ff5f4d-bfhxj

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

AddedInterface

Add eth0 [10.132.1.105/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ffce13: serviceaccount "payload-processing-e2e-inf-a-ffce13" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ffce13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ffce13-b86df9f45 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ffce13-b86df9f45

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ffce13-b86df9f45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ffce13: serviceaccount "payload-processing-e2e-inf-a-ffce13" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

AddedInterface

Add eth0 [10.132.1.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ffce13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ffce13-b86df9f45

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-345bc4-75c8dc5f7f-cnrd4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-345bc4-7555945897-88pml

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-99668e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w2-176db5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-176db5-openshift-default-76d7ddc765 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-176db5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-99668e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-99668e-openshift-default-67c7577f5c from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-99668e-openshift-default-67c7577f5c

SuccessfulCreate

Created pod: e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

openshift-ingress

replicaset-controller

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765

SuccessfulCreate

Created pod: e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

openshift-ingress

multus

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

AddedInterface

Add eth0 [10.132.1.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

Started

Container started
(x24)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-z94z5

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2ac526

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2ac526

openshift-ingress

deployment-controller

e2e-inf-a-2ac526-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2ac526-openshift-default-845b5867fc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-2ac526-openshift-default-845b5867fc

SuccessfulCreate

Created pod: e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp
(x6)

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

Unhealthy

Startup probe failed: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

ProbeError

Startup probe error: Get "http://10.132.1.110:15021/healthz/ready": dial tcp 10.132.1.110:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

AddedInterface

Add eth0 [10.132.1.111/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2ac526-5b545557d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2ac526-5b545557d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2ac526: serviceaccount "payload-processing-e2e-inf-a-2ac526" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2ac526

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

openshift-ingress

multus

payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6

AddedInterface

Add eth0 [10.132.1.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2ac526: serviceaccount "payload-processing-e2e-inf-a-2ac526" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2ac526-5b545557d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2ac526

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2ac526-5b545557d7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

AddedInterface

Add eth0 [10.132.1.114/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5506f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5506f4

openshift-ingress

multus

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-5506f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5506f4-openshift-default-75fcfff45c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-5506f4-openshift-default-75fcfff45c

SuccessfulCreate

Created pod: e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-9hc4m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-mrttp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-hdsjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-wdjgk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5506f4-7587579679

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5506f4-7587579679

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5506f4-7587579679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5506f4: serviceaccount "payload-processing-e2e-inf-b-5506f4" not found

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5506f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5506f4-7587579679 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5506f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc from 0 to 1

openshift-ingress

kubelet

e2e-extmod-a-345bc4-openshift-default-c59dc5c89-j8z9h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5506f4: serviceaccount "payload-processing-e2e-inf-b-5506f4" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

AddedInterface

Add eth0 [10.132.1.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

AddedInterface

Add eth0 [10.132.1.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-b-9b78e4-openshift-default-64bbf7f759

SuccessfulCreate

Created pod: e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

openshift-ingress

deployment-controller

e2e-inf-b-9b78e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9b78e4-openshift-default-64bbf7f759 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9b78e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9b78e4
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-d5dmn

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-sb5c9

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fmzmj

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-sb5c9

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

Unhealthy

Readiness probe failed: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

ProbeError

Readiness probe error: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x4)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5506f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5506f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

Unhealthy

Readiness probe failed: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b78e4: serviceaccount "payload-processing-e2e-inf-b-9b78e4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9b78e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9b78e4-7fdbd787bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b78e4: serviceaccount "payload-processing-e2e-inf-b-9b78e4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9b78e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

ProbeError

Readiness probe error: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

AddedInterface

Add eth0 [10.132.1.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv

AddedInterface

Add eth0 [10.132.1.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

ProbeError

Readiness probe error: Get "http://10.132.1.95:15021/healthz/ready": dial tcp 10.132.1.95:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Unhealthy

Readiness probe failed: Get "http://10.132.1.95:15021/healthz/ready": dial tcp 10.132.1.95:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Unhealthy

Startup probe failed: Get "http://10.132.1.95:15021/healthz/ready": dial tcp 10.132.1.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

ProbeError

Startup probe error: Get "http://10.132.1.95:15021/healthz/ready": dial tcp 10.132.1.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-a574c2-5b8867994f-rbwqg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ffce13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-a574c2-b7c7776ff-7zjsn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ffce13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ddcf93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ddcf93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-x56cr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-a3fb70-openshift-default-98f99985f

SuccessfulCreate

Created pod: e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a3fb70

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a3fb70

openshift-ingress

deployment-controller

e2e-inf-b-a3fb70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a3fb70-openshift-default-98f99985f from 0 to 1

openshift-ingress

multus

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-a574c2-openshift-default-5c5f754885-hlc4x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a3fb70: serviceaccount "payload-processing-e2e-inf-b-a3fb70" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a3fb70-64468497c7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a3fb70-64468497c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a3fb70: serviceaccount "payload-processing-e2e-inf-b-a3fb70" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a3fb70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a3fb70-6db779f887 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a3fb70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a3fb70-64468497c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a3fb70-64468497c7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

AddedInterface

Add eth0 [10.132.1.121/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

AddedInterface

Add eth0 [10.132.1.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ffce13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ffce13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ddcf93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-ddcf93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2ac526-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2ac526-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

Unhealthy

Startup probe failed: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

ProbeError

Startup probe error: Get "http://10.132.1.111:15021/healthz/ready": dial tcp 10.132.1.111:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-176db5-6ff4d88787-2xb9q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-176db5-7d788cc755-kjj8n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-t7fbs

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5506f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-176db5-openshift-default-76d7ddc765-x6dh9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5506f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2ac526-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2ac526-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Unhealthy

Readiness probe failed: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

ProbeError

Readiness probe error: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

Unhealthy

Startup probe failed: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

ProbeError

Startup probe error: Get "http://10.134.0.234:15021/healthz/ready": dial tcp 10.134.0.234:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-74f9f4-66f7cbbd6c-c79gm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-74f9f4-5db96dc479-v6c2l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-g7v27

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-74f9f4-openshift-default-5dcf868997-8sg6v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a3fb70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a3fb70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-a-0c4052

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-0c4052

openshift-ingress

deployment-controller

e2e-inf-a-0c4052-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-0c4052-openshift-default-7d5b5958dc from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-0c4052-openshift-default-7d5b5958dc

SuccessfulCreate

Created pod: e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

openshift-ingress

multus

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-0c4052

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0c4052-5fcb7d75df

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-0c4052-5fcb7d75df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0c4052: serviceaccount "payload-processing-e2e-inf-a-0c4052" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0c4052: serviceaccount "payload-processing-e2e-inf-a-0c4052" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0c4052-5fcb7d75df

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-0c4052

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-0c4052-5fcb7d75df from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a3fb70-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a3fb70-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-8e4acb-9797567d5-l5k7m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-8e4acb-7b65d5967f-t74mc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a3fb70-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-a3fb70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a3fb70-openshift-default-98f99985f from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-b-a3fb70-openshift-default-98f99985f

SuccessfulCreate

Created pod: e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

openshift-ingress

multus

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

Started

Container started
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9b78e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9b78e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

Unhealthy

Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

ProbeError

Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

Unhealthy

Readiness probe failed: Get "http://10.134.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

ProbeError

Readiness probe error: Get "http://10.134.0.238:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-inf-b-f8e2c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f8e2c3-openshift-default-9b5c4b479 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-f8e2c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f8e2c3

openshift-ingress

replicaset-controller

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479

SuccessfulCreate

Created pod: e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

openshift-ingress

multus

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2qs4m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-2wnxj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-8e4acb-openshift-default-868dc48fff-5pbvh

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f8e2c3: serviceaccount "payload-processing-e2e-inf-b-f8e2c3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-f8e2c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-f8e2c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f8e2c3: serviceaccount "payload-processing-e2e-inf-b-f8e2c3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

AddedInterface

Add eth0 [10.134.0.241/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

Unhealthy

Startup probe failed: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

ProbeError

Startup probe error: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0c4052-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-0c4052-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

ProbeError

Startup probe error: Get "http://10.134.0.240:15021/healthz/ready": dial tcp 10.134.0.240:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

Unhealthy

Startup probe failed: Get "http://10.134.0.240:15021/healthz/ready": dial tcp 10.134.0.240:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f8e2c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f8e2c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f8e2c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f8e2c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-f9a819-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-f9a819-openshift-default-78c5969f59 from 3 to 2
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w3-f9a819-openshift-default-78c5969f59

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f9a819-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-g9f84

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-mnctg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479

SuccessfulCreate

Created pod: e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

Started

Container started

openshift-ingress

deployment-controller

e2e-inf-b-f8e2c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f8e2c3-openshift-default-9b5c4b479 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f8e2c3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

ProbeError

Startup probe error: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

Unhealthy

Startup probe failed: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-5506f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5506f4-openshift-default-75fcfff45c from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-5506f4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-b-5506f4-openshift-default-75fcfff45c

SuccessfulCreate

Created pod: e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

Unhealthy

Startup probe failed: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

ProbeError

Startup probe error: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-99668e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-99668e-openshift-default-67c7577f5c from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-99668e-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-99668e-openshift-default-67c7577f5c

SuccessfulDelete

Deleted pod: e2e-extmod-a-99668e-openshift-default-67c7577f5c-69ckp

openshift-ingress

deployment-controller

e2e-extmod-a-00909f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-00909f-openshift-default-7c565998f7 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-00909f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-00909f-openshift-default-7c565998f7

SuccessfulDelete

Deleted pod: e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-mgpgx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-xr9v5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-6nj94

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-x6r22

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-xr9v5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-x6r22

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-6nj94

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 10 to 7

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2ac526-5b545557d7-zw4r6

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-a-w1-e53c37-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-e53c37-openshift-default-84d754496f from 2 to 1

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-e53c37-openshift-default-84d754496f

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-e53c37-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ffce13-7bc988d7cf-s4bv9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ffce13-b86df9f45-tvl4b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-ktlqv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-321ccd-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w1-321ccd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-mxtdq

openshift-ingress

kubelet

e2e-inf-a-ffce13-openshift-default-745589f55f-jtl8k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-2ac526-openshift-default-845b5867fc-4qxbp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b78e4-7fdbd787bf-jmljv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2ac526-8659cfcc6c-mpnc8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b78e4-7dc6846c5f-mqx5d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-9b78e4-openshift-default-64bbf7f759-x72sw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-ddcf93-openshift-default-78f6598b5c-v89jr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-m9hpf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e07442-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a3fb70-6db779f887-zqwtz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a3fb70-64468497c7-9t2bs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-a3fb70-openshift-default-98f99985f-wkhxx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-extmod-b-e07442-openshift-default-56d77688d5

SuccessfulDelete

Deleted pod: e2e-extmod-b-e07442-openshift-default-56d77688d5-bjsvd

openshift-ingress

deployment-controller

e2e-extmod-b-e07442-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-e07442-openshift-default-56d77688d5 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-e1e0f5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc

SuccessfulDelete

Deleted pod: e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-5js6z

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e1e0f5-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddcf93-56fc6ff47f-l6zsk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddcf93-75fd559bb7-g7v24

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-e8063c-openshift-default-dc6f7fbc7-m66rq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-5cpnr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e8063c-75f8dc5547-wqbsx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-5506f4-openshift-default-75fcfff45c-r6tmv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e8063c-749c5dc57-jf8b6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-99668e-79c94cc98f-nndks

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-99668e-5d75c6c6c-9qtmt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-99668e-openshift-default-67c7577f5c-gq2xd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-qm4kr

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-qm4kr

Killing

Stopping container discovery

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

Killing

Stopping container payload-processing
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 7 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-9cqch

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-9cqch
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-317a33-openshift-default-6d6f98675

SuccessfulDelete

Deleted pod: e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-b7dfd

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

deployment-controller

e2e-worker-w1-317a33-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-317a33-openshift-default-6d6f98675 from 3 to 2
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-317a33-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5506f4-6db66ccddc-gg2k2

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.1.116:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

e2e-inf-b-f8e2c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-f8e2c3-openshift-default-9b5c4b479 from 2 to 3

openshift-ingress

replicaset-controller

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479

SuccessfulCreate

Created pod: e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-f8e2c3-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5506f4-7587579679-r6sfj

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.1.117:50052" within 1s: context deadline exceeded

openshift-ingress

multus

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

AddedInterface

Add eth0 [10.132.1.163/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-e1e0f5-openshift-default-dd58f9dcc-slkjn

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

ProbeError

Startup probe error: Get "http://10.132.1.163:15021/healthz/ready": dial tcp 10.132.1.163:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

Unhealthy

Startup probe failed: Get "http://10.132.1.163:15021/healthz/ready": dial tcp 10.132.1.163:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e1e0f5-5dd7c6fff-twpp7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e1e0f5-9c9d969cc-ztr4c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-00909f-openshift-default-7c565998f7-h2t6g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-e07442-openshift-default-56d77688d5-wr565

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-00909f-64695dc5f5-mjrss

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-00909f-6c5f4bff55-5x7r6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f147de-659b45bcff-4mht2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f147de-7c6dcb6dff-xj76w

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e07442-55fb7dd479-f5bkj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e07442-8f78fbd57-w9ql8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-3a65ec-openshift-default-9f9996889-snwhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-3a65ec-66fc647b99-5kthb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-3a65ec-5cd567f4ff-b9kkk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-8fa15b-openshift-default-6cf456b647-8mvmz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0c4052-5fcb7d75df-pr974

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.181:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-f147de-openshift-default-756bddc4df-sb6rz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-0c4052-openshift-default-7d5b5958dc-2rll4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8fa15b-c5f767997-jxnrd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8fa15b-b445f959-v6nb6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-f8e2c3-fcb9cf6cc-cgzmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-bd64b

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0c4052-6f5875db4c-9jxk7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-qbpx6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-qbpx6
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-a50675-7c46f9867f-q6vrg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-a50675-openshift-default-85dcc5678f-7xsn9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-a50675-bc4d4d67f-lzfvh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-f64640-openshift-default-d945bfdb7-wr5k7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-53aa47-openshift-default-9cbf98959

SuccessfulCreate

Created pod: e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-53aa47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-53aa47-openshift-default-9cbf98959 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-53aa47-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-vkf7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

Started

Container started

openshift-ingress

multus

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

AddedInterface

Add eth0 [10.132.1.178/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-qbdlb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-f8e2c3-openshift-default-9b5c4b479-nj9xt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-53aa47-67f966d869-ldll6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-53aa47-76d657f955-rk78p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f64640-9df885d47-qvq5b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f64640-6f868446cc-q45qb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

Unhealthy

Startup probe failed: Get "http://10.132.1.178:15021/healthz/ready": dial tcp 10.132.1.178:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

ProbeError

Startup probe error: Get "http://10.132.1.178:15021/healthz/ready": dial tcp 10.132.1.178:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

Unhealthy

Startup probe failed: Get "http://10.132.1.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

ProbeError

Startup probe error: Get "http://10.132.1.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-f8e2c3-7566d47887-ns6bx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-82jg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-c7dvf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-53aa47-openshift-default-9cbf98959-84wg6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-bc102e-779576d99-xvt86

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-bc102e-555d6fdb7c-9jmn9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-6741b1-openshift-default-5954d7485c-w6zrq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-dkw9t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-bc102e-openshift-default-6bfc9f987f-688n7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f9a819-79dd6b768f-xbw6d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f9a819-5c88dbbb55-bnshr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6741b1-6c786b975c-hcpkc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6741b1-fdc8444dc-sfmlv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-j9hzd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-f9a819-openshift-default-78c5969f59-5rfrc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-9cmc5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d95261-openshift-default-664cbbcc4f-z6trs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d95261-69665dc795-nz2vk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d95261-7f85f5cf87-bc65z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-e53c37-openshift-default-84d754496f-b5smx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-e53c37-7c4c57b895-cftg4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-e53c37-69cf6c7887-bwjst

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

Unhealthy

Readiness probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w1-321ccd-openshift-default-787dff9cd7-v4s5x

ProbeError

Readiness probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-321ccd-55fb65b87c-8w6rp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-321ccd-5dd864d547-hg97g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-317a33-74fbf67dcc-4tdfz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-bvvrt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-317a33-openshift-default-6d6f98675-dvm24

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-317a33-849fd968c5-76klt

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.54:50052" within 1s: context deadline exceeded