Time Namespace Component RelatedObject Reason Message

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6 to ip-10-0-129-105.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-69546f6877-5ttnd

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-69546f6877-5ttnd to ip-10-0-143-244.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-gv64t

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-gv64t to ip-10-0-143-244.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-69546f6877-9f229

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-69546f6877-9f229 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c to ip-10-0-143-244.ec2.internal

opendatahub

test-curl-11390-c32e14

Scheduled

Successfully assigned opendatahub/test-curl-11390-c32e14 to ip-10-0-129-105.ec2.internal

opendatahub

test-curl-11390-bc19eb

Scheduled

Successfully assigned opendatahub/test-curl-11390-bc19eb to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n to ip-10-0-143-244.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-69546f6877-9ml2g

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-69546f6877-9ml2g to ip-10-0-129-105.ec2.internal

opendatahub

test-curl-11390-7b5a70

Scheduled

Successfully assigned opendatahub/test-curl-11390-7b5a70 to ip-10-0-129-105.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-tm7gg

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-tm7gg to ip-10-0-129-105.ec2.internal

opendatahub

test-curl-11390-5c41f2

Scheduled

Successfully assigned opendatahub/test-curl-11390-5c41f2 to ip-10-0-129-105.ec2.internal

openshift-ingress

router-default-7888d9c8bc-nzrhq

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7888d9c8bc-nzrhq

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7888d9c8bc-nzrhq

Scheduled

Successfully assigned openshift-ingress/router-default-7888d9c8bc-nzrhq to ip-10-0-129-105.ec2.internal

opendatahub

test-curl-11390-379eb6

Scheduled

Successfully assigned opendatahub/test-curl-11390-379eb6 to ip-10-0-143-244.ec2.internal

opendatahub

test-curl-11387-146e92

Scheduled

Successfully assigned opendatahub/test-curl-11387-146e92 to ip-10-0-135-148.ec2.internal

opendatahub

test-curl-11378-fb8d68

Scheduled

Successfully assigned opendatahub/test-curl-11378-fb8d68 to ip-10-0-143-244.ec2.internal

opendatahub

test-curl-11378-ed61b7

Scheduled

Successfully assigned opendatahub/test-curl-11378-ed61b7 to ip-10-0-143-244.ec2.internal

opendatahub

test-curl-11378-3b28d5

Scheduled

Successfully assigned opendatahub/test-curl-11378-3b28d5 to ip-10-0-129-105.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-57dc67465-lndw2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-57dc67465-lndw2 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s to ip-10-0-129-105.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-b7d79

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-b7d79 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g to ip-10-0-143-244.ec2.internal

kuadrant-system

authorino-57f7f8659f-9prmh

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-9prmh to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9 to ip-10-0-143-244.ec2.internal

kuadrant-system

authorino-6889cbd8c4-p6vws

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-p6vws to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm to ip-10-0-135-148.ec2.internal

kuadrant-system

authorino-6f6944bcdd-pkb2p

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-pkb2p to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9 to ip-10-0-129-105.ec2.internal

kuadrant-system

authorino-74d66bdc9c-wxffc

Scheduled

Successfully assigned kuadrant-system/authorino-74d66bdc9c-wxffc to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc to ip-10-0-129-105.ec2.internal

kuadrant-system

authorino-844c8bbcf4-46cp6

Scheduled

Successfully assigned kuadrant-system/authorino-844c8bbcf4-46cp6 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g to ip-10-0-129-105.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-8dscb

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-8dscb to ip-10-0-129-105.ec2.internal

opendatahub

odh-model-controller-769875db56-dkbbc

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-dkbbc to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j to ip-10-0-129-105.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-mpftf

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-mpftf to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

Scheduled

Successfully assigned openshift-ingress/e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh to ip-10-0-143-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-x7j7f

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-x7j7f to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq to ip-10-0-135-148.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-slvzx

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-slvzx to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

Scheduled

Successfully assigned openshift-ingress/e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht to ip-10-0-143-244.ec2.internal

opendatahub

maas-controller-786557dc8d-4rrhf

Scheduled

Successfully assigned opendatahub/maas-controller-786557dc8d-4rrhf to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t to ip-10-0-135-148.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-pwnjf

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-pwnjf to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf to ip-10-0-143-244.ec2.internal

opendatahub

maas-controller-687fd9c8d8-gt7tl

Scheduled

Successfully assigned opendatahub/maas-controller-687fd9c8d8-gt7tl to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9 to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2 to ip-10-0-143-244.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-n98s2

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-n98s2 to ip-10-0-129-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-97vfn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-97vfn to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh to ip-10-0-143-244.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-v4v2x

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-v4v2x to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9 to ip-10-0-129-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9z6xd to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm to ip-10-0-129-105.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-wdbpk

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-wdbpk to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm to ip-10-0-129-105.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-nn4h9

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-nn4h9 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc to ip-10-0-129-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-nkb2b

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-nkb2b to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd to ip-10-0-143-244.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-vzh5l

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-vzh5l to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b to ip-10-0-129-105.ec2.internal

openshift-ingress

kube-auth-proxy-767d5cbf5-8tqvw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-767d5cbf5-8tqvw to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6 to ip-10-0-135-148.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-4wqhg

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-4wqhg to ip-10-0-129-105.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-sh5jh

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-sh5jh to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p to ip-10-0-143-244.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-f64pg

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-f64pg to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-356553-54cf695556-7vstx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-356553-54cf695556-7vstx to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj to ip-10-0-129-105.ec2.internal

openshift-ingress

kube-auth-proxy-767d5cbf5-vx9wj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-767d5cbf5-vx9wj to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-2hjgz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-2hjgz to ip-10-0-135-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-2pgpc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-2pgpc to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc to ip-10-0-129-105.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-4ln46

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-4ln46 to ip-10-0-135-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-5cq5q

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-5cq5q to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-5krd5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-5krd5 to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-8k2jx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-8k2jx to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-b8mzp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-b8mzp to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-dwcq7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-dwcq7 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67 to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-fh6qf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-fh6qf to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-hl5zf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-hl5zf to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68 to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-hxpzc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-hxpzc to ip-10-0-135-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-k5n95

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-k5n95 to ip-10-0-135-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-k7rc9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-k7rc9 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-kg5zv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-kg5zv to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-knmrm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-knmrm to ip-10-0-129-105.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-zt6jf

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-zt6jf to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-lpk2w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-lpk2w to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-p6d95

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-p6d95 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-t2zhx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-t2zhx to ip-10-0-135-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-tjlgk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-tjlgk to ip-10-0-129-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-v8xs6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-v8xs6 to ip-10-0-135-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-vbklx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-vbklx to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-vnxfr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-vnxfr to ip-10-0-135-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-77f556d647-z896s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-77f556d647-z896s to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx to ip-10-0-135-148.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-b6z6c

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-b6z6c to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r to ip-10-0-129-105.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-2h599

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-2h599 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4 to ip-10-0-143-244.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55 to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm to ip-10-0-143-244.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-28h4p

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-28h4p to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46 to ip-10-0-135-148.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-56jtq

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-56jtq to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-l6sj2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-l6sj2 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46 to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8 to ip-10-0-143-244.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p to ip-10-0-135-148.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-jbjpj

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-jbjpj to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd to ip-10-0-143-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-fw98g

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-fw98g to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt to ip-10-0-129-105.ec2.internal

cert-manager

cert-manager-597b95cb84-hrwbd

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-hrwbd to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f to ip-10-0-143-244.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-356553-openshift-default-766c847c47-482qh to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6 to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg to ip-10-0-143-244.ec2.internal

models-as-a-service

payload-processing-external-model-56dc545b7c-d92fs

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-56dc545b7c-d92fs to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz to ip-10-0-143-244.ec2.internal

models-as-a-service

payload-processing-external-model-58fbcd848f-ssc8v

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-58fbcd848f-ssc8v to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28 to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8 to ip-10-0-143-244.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-88c6v

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-88c6v to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4 to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt to ip-10-0-135-148.ec2.internal

models-as-a-service

payload-processing-external-model-59686ffd74-722wt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-59686ffd74-722wt to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n to ip-10-0-129-105.ec2.internal

models-as-a-service

payload-processing-external-model-59686ffd74-bpf8q

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-59686ffd74-bpf8q to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-85rhg

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-85rhg to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf to ip-10-0-129-105.ec2.internal

models-as-a-service

payload-processing-external-model-5fbb64fb6b-mgvv7

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5fbb64fb6b-mgvv7 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6 to ip-10-0-143-244.ec2.internal

opendatahub

ai-gateway-controller-5bbbc667d4-sdbtx

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5bbbc667d4-sdbtx to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg to ip-10-0-143-244.ec2.internal

models-as-a-service

payload-processing-external-model-74f944f77-jfq98

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-74f944f77-jfq98 to ip-10-0-135-148.ec2.internal

openshift-jobset-operator

jobset-controller-manager-55bdb968bb-g6td4

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-55bdb968bb-g6td4 to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9371b7-789f894498-rb2gj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9371b7-789f894498-rb2gj to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj to ip-10-0-129-105.ec2.internal

models-as-a-service

payload-processing-external-model-7859b55bb7-k5djn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7859b55bb7-k5djn to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-648892-578444d976-xxlck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-648892-578444d976-xxlck to ip-10-0-143-244.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-lwrbj

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-lwrbj to ip-10-0-135-148.ec2.internal

openshift-ingress

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn to ip-10-0-129-105.ec2.internal

models-as-a-service

payload-processing-external-model-85fdfbb6b6-vkrhd

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-85fdfbb6b6-vkrhd to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4 to ip-10-0-129-105.ec2.internal

openshift-ingress

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg to ip-10-0-129-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz to ip-10-0-135-148.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg to ip-10-0-143-244.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7888d9c8bc from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-7888d9c8bc

SuccessfulCreate

Created pod: router-default-7888d9c8bc-nzrhq
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-7888d9c8bc-nzrhq

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7888d9c8bc-nzrhq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x4)

openshift-ingress

kubelet

router-default-7888d9c8bc-nzrhq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7888d9c8bc-nzrhq

Started

Container started

openshift-ingress

kubelet

router-default-7888d9c8bc-nzrhq

Created

Container created

openshift-ingress

kubelet

router-default-7888d9c8bc-nzrhq

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-7888d9c8bc-nzrhq

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-x7j7f

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-x7j7f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-x7j7f

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-x7j7f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.69s (2.69s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-x7j7f

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-x7j7f

Started

Container started

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-x7j7f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-z896s

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-x7j7f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-689986b98c

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-689986b98c from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-z896s

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.411s (8.411s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-689986b98c-c6v55

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 8.592s (8.592s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-lwrbj

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-lwrbj

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lwrbj

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lwrbj

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lwrbj

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-lwrbj_1c1fc7ef-8a10-41bf-b4b2-70920bab97de became leader

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-lwrbj

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.356s (2.356s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-69546f6877

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-69546f6877-9ml2g

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-69546f6877

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-69546f6877-9f229

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-69546f6877 from 0 to 3

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-69546f6877-9ml2g

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-69546f6877-5ttnd

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-69546f6877-9f229

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.702s (2.702s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.639s (2.639s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.658s (2.658s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 382ms (382ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-69546f6877-5ttnd_5c7a592c-a080-44b1-9283-a3deeac78e41

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-69546f6877-5ttnd_5c7a592c-a080-44b1-9283-a3deeac78e41 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9ml2g

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 312ms (312ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-9f229

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-69546f6877-5ttnd

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 332ms (332ms including waiting). Image size: 273709574 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-rr5x6

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-tm7gg

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-tm7gg

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-tm7gg

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-nn4h9

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nn4h9

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-4wqhg

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-nn4h9

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-4wqhg

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-tm7gg

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-tm7gg

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.446s (2.446s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4wqhg

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-tm7gg

Started

Container started

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-slvzx

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

limitador-operator-controller-manager-5778bb4449-4wqhg_b3d60ea7-f876-427b-affe-ff708e92f300

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-4wqhg_b3d60ea7-f876-427b-affe-ff708e92f300 became leader

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4wqhg

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4wqhg

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nn4h9

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4wqhg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.227s (2.227s including waiting). Image size: 177967631 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nn4h9

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.882s (2.882s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-nn4h9

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-slvzx

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-slvzx

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-slvzx

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-slvzx

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-slvzx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.284s (1.284s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-slvzx_d11a8d4c-8c10-453c-b302-305cb975d83a

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-slvzx_d11a8d4c-8c10-453c-b302-305cb975d83a became leader
(x9)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-hrwbd

cert-manager

kubelet

cert-manager-597b95cb84-hrwbd

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-8dscb

cert-manager

multus

cert-manager-597b95cb84-hrwbd

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-hrwbd

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-hrwbd

Started

Container started

kuadrant-system

multus

authorino-operator-7b7bb4bc77-8dscb

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-8dscb

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

authorino-operator-7b7bb4bc77-8dscb_372419a1-c294-4893-8990-eb7e8d469006

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-8dscb_372419a1-c294-4893-8990-eb7e8d469006 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-8dscb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.288s (1.288s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-8dscb

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-8dscb

Started

Container started

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-v4v2x

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-v4v2x

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-v4v2x

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-v4v2x

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-v4v2x

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.061s (4.061s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-v4v2x_2a292a19-1100-4abd-8a22-27614cb644ac

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-v4v2x_2a292a19-1100-4abd-8a22-27614cb644ac became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-v4v2x

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-vx9wj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-8tqvw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

replicaset-controller

kube-auth-proxy-767d5cbf5

SuccessfulCreate

Created pod: kube-auth-proxy-767d5cbf5-8tqvw

openshift-ingress

replicaset-controller

kube-auth-proxy-767d5cbf5

SuccessfulCreate

Created pod: kube-auth-proxy-767d5cbf5-vx9wj

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-767d5cbf5 from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-57dc67465

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-57dc67465-lndw2

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-57dc67465-lndw2

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-57dc67465-lndw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

kube-auth-proxy-767d5cbf5-vx9wj

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-767d5cbf5-8tqvw

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-57dc67465 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-57dc67465-lndw2

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-57dc67465-lndw2

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-8tqvw

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-8tqvw

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-8tqvw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.222s (2.222s including waiting). Image size: 188904677 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-vx9wj

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-vx9wj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.385s (2.386s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-767d5cbf5-vx9wj

Started

Container started

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-b6z6c

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-b6z6c

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-b6z6c

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-b6z6c

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-b6z6c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.089s (2.089s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-b6z6c

Started

Container started

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-zn286"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-brmnr"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-55bdb968bb from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-55bdb968bb

SuccessfulCreate

Created pod: jobset-controller-manager-55bdb968bb-g6td4

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

kubelet

jobset-controller-manager-55bdb968bb-g6td4

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-55bdb968bb-g6td4

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-55bdb968bb-g6td4

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.879s (2.879s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-55bdb968bb-g6td4

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-55bdb968bb-g6td4

Started

Container started

openshift-jobset-operator

jobset-controller-manager-55bdb968bb-g6td4_7f00affe-5fe0-458f-82cd-00fc7c4209b2

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-55bdb968bb-g6td4_7f00affe-5fe0-458f-82cd-00fc7c4209b2 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-b6z6c_1fb20917-28e7-489a-9389-3196cd7999bb

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-b6z6c_1fb20917-28e7-489a-9389-3196cd7999bb became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-nkb2b

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-28h4p

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-nkb2b

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nkb2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nkb2b

Started

Container started

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nkb2b

Created

Container created

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-sh5jh

opendatahub

kubelet

kserve-controller-manager-776cc66d47-28h4p

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sh5jh

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-sh5jh

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-dkbbc

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

kserve-controller-manager-776cc66d47-28h4p

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-mpftf

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nkb2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-nkb2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

multus

odh-model-controller-769875db56-dkbbc

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-dkbbc

opendatahub

multus

model-serving-api-75bd89fdfc-mpftf

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-mpftf

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-x7j7f

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-x7j7f

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-mpftf

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sh5jh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.079s (2.079s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-28h4p

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 1.921s (1.921s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-28h4p

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-28h4p

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sh5jh

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-mpftf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.558s (1.558s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sh5jh

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-mpftf

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-dkbbc

Started

Container started

opendatahub

odh-model-controller-769875db56-dkbbc_bc2ee2f1-5c96-44a8-b4e8-a23810c6e9b4

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-dkbbc_bc2ee2f1-5c96-44a8-b4e8-a23810c6e9b4 became leader

opendatahub

kserve-controller-manager-776cc66d47-28h4p_1c5ca1e8-4935-4960-9acb-0c9c8c6f181e

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-28h4p_1c5ca1e8-4935-4960-9acb-0c9c8c6f181e became leader

opendatahub

kubelet

odh-model-controller-769875db56-dkbbc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.654s (2.654s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-dkbbc

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-sh5jh_a7614a8b-1b0f-4e72-bf35-206c2a235d9a

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-sh5jh_a7614a8b-1b0f-4e72-bf35-206c2a235d9a became leader
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-v4v2x

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-n98s2

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-n98s2

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-n98s2

Started

Container started

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-n98s2

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-n98s2

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-n98s2_0525ef6e-b6fe-41c3-bbcb-b471e1a28c95

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-n98s2_0525ef6e-b6fe-41c3-bbcb-b471e1a28c95 became leader

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-pwnjf

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-wdbpk

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

multus

limitador-limitador-74dfcfb894-wdbpk

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-pwnjf

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wdbpk

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-pwnjf

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-vzh5l

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-9prmh

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-b7d79

kuadrant-system

multus

authorino-57f7f8659f-9prmh

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-9prmh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

multus

limitador-limitador-7c9b87d574-vzh5l

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vzh5l

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

authorino-56c6c9ddd5-b7d79

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-b7d79

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-9prmh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.17s (2.17s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vzh5l

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vzh5l

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wdbpk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.43s (2.43s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wdbpk

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wdbpk

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-vzh5l

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 783ms (783ms including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-b7d79

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-b7d79

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-b7d79

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.304s (2.304s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-9prmh

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-9prmh

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-9prmh

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-pwnjf

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.085s (5.085s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-pwnjf

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-pwnjf

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-9prmh

Killing

Stopping container authorino

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wdbpk

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-wdbpk

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-687fd9c8d8 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-786557dc8d from 0 to 1

opendatahub

replicaset-controller

maas-controller-786557dc8d

SuccessfulCreate

Created pod: maas-controller-786557dc8d-4rrhf

opendatahub

replicaset-controller

maas-controller-687fd9c8d8

SuccessfulCreate

Created pod: maas-controller-687fd9c8d8-gt7tl

opendatahub

kubelet

maas-controller-786557dc8d-4rrhf

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd"

opendatahub

multus

maas-controller-786557dc8d-4rrhf

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-687fd9c8d8-gt7tl

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd"

opendatahub

multus

maas-controller-687fd9c8d8-gt7tl

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-786557dc8d-4rrhf

Started

Container started

opendatahub

kubelet

maas-controller-786557dc8d-4rrhf

Created

Container created

opendatahub

kubelet

maas-controller-786557dc8d-4rrhf

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.636s (2.636s including waiting). Image size: 200069630 bytes.

opendatahub

kubelet

maas-controller-687fd9c8d8-gt7tl

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.531s (2.531s including waiting). Image size: 200069630 bytes.

opendatahub

maas-controller-786557dc8d-4rrhf_1ac46e14-6456-41cc-aa6b-500a1f3b379b

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-786557dc8d-4rrhf_1ac46e14-6456-41cc-aa6b-500a1f3b379b became leader

opendatahub

kubelet

maas-controller-687fd9c8d8-gt7tl

Started

Container started

opendatahub

kubelet

maas-controller-687fd9c8d8-gt7tl

Created

Container created

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-gv64t

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-gv64t

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gv64t

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-786557dc8d from 1 to 0

opendatahub

replicaset-controller

maas-controller-786557dc8d

SuccessfulDelete

Deleted pod: maas-controller-786557dc8d-4rrhf

opendatahub

kubelet

maas-controller-786557dc8d-4rrhf

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gv64t

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gv64t

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gv64t

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 10.278s (10.278s including waiting). Image size: 1089502687 bytes.

opendatahub

maas-controller-687fd9c8d8-gt7tl_25a575f7-623d-4e60-962a-98615def6f91

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-687fd9c8d8-gt7tl_25a575f7-623d-4e60-962a-98615def6f91 became leader

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-844c8bbcf4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-pkb2p

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-p6vws

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

Created

Container created

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-pkb2p
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

Started

Container started

kuadrant-system

replicaset-controller

authorino-844c8bbcf4

SuccessfulCreate

Created pod: authorino-844c8bbcf4-46cp6

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-p6vws

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

kubelet

authorino-844c8bbcf4-46cp6

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-844c8bbcf4-46cp6

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-844c8bbcf4-46cp6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 687ms (687ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-b7d79

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-b7d79

kuadrant-system

kubelet

authorino-844c8bbcf4-46cp6

Started

Container started

kuadrant-system

kubelet

authorino-844c8bbcf4-46cp6

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-f64pg

opendatahub

multus

llmisvc-controller-manager-6466c554d8-f64pg

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-f64pg

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-f64pg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 739ms (739ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-f64pg

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-f64pg

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

ProbeError

Startup probe error: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

Unhealthy

Startup probe failed: Get "http://10.132.0.32:15021/healthz/ready": dial tcp 10.132.0.32:15021: connect: connection refused

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-sh5jh

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-sh5jh

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-88c6v

opendatahub

kubelet

ai-gateway-controller-7d85675f98-88c6v

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"
(x6)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

ai-gateway-controller-7d85675f98-88c6v

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes
(x6)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

ai-gateway-controller-7d85675f98-88c6v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.551s (1.551s including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-88c6v

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-88c6v

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-88c6v_b4cd4ca7-a322-43a3-a65a-c852d34b6a81

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-88c6v_b4cd4ca7-a322-43a3-a65a-c852d34b6a81 became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-85rhg

openshift-ingress

multus

payload-processing-5f78687d5b-85rhg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-l6sj2

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-l6sj2

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-85rhg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-l6sj2

openshift-ingress

kubelet

payload-processing-5f78687d5b-85rhg

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-85rhg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.278s (2.278s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-85rhg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-l6sj2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-l6sj2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-l6sj2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.246s (2.246s including waiting). Image size: 125317101 bytes.

opendatahub

multus

ai-gateway-controller-5bbbc667d4-sdbtx

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-5bbbc667d4

SuccessfulCreate

Created pod: ai-gateway-controller-5bbbc667d4-sdbtx

opendatahub

kubelet

ai-gateway-controller-5bbbc667d4-sdbtx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5bbbc667d4 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-5bbbc667d4-sdbtx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 327ms (327ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-5bbbc667d4-sdbtx

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5bbbc667d4-sdbtx

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-f64pg_7361c868-62b2-4311-870f-3e5e7264b5f1

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-f64pg_7361c868-62b2-4311-870f-3e5e7264b5f1 became leader

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-88c6v

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-88c6v

Killing

Stopping container manager

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-g5jjc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.166s (1.166s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-zt6jf

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-zt6jf

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zt6jf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 216ms (216ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zt6jf

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zt6jf

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zt6jf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-2h599

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-2h599

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 216ms (216ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-2h599

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-2h599

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-56jtq

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-56jtq

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-2h599

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-2h599

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-56jtq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 208ms (208ms including waiting). Image size: 98346788 bytes.

opendatahub

ai-gateway-controller-5bbbc667d4-sdbtx_af2fda96-f9af-48b6-bc84-5c6e17dc667b

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5bbbc667d4-sdbtx_af2fda96-f9af-48b6-bc84-5c6e17dc667b became leader

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-56jtq

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-56jtq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.129s (1.129s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-56jtq

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xq7t

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

multus

echo-simulator-kserve-64b6f8f96c-jbjpj

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-jbjpj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-jbjpj

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

kubelet

echo-simulator-kserve-64b6f8f96c-jbjpj

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-jbjpj

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-jbjpj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.488s (1.488s including waiting). Image size: 78208878 bytes.

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 181ms (181ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-rrfbf

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 211ms (211ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-vbklx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-v8xs6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-kg5zv

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 1 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-v8xs6

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-v8xs6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-kg5zv

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-vbklx

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vbklx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vbklx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.949s (2.949s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-v8xs6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vbklx

Started

Container started

kuadrant-system

replicaset-controller

authorino-74d66bdc9c

SuccessfulCreate

Created pod: authorino-74d66bdc9c-wxffc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-v8xs6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-v8xs6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.653s (2.653s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vbklx

Created

Container created

kuadrant-system

kubelet

authorino-74d66bdc9c-wxffc

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-74d66bdc9c-wxffc

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-74d66bdc9c-wxffc

Started

Container started

kuadrant-system

kubelet

authorino-74d66bdc9c-wxffc

Created

Container created

kuadrant-system

kubelet

authorino-74d66bdc9c-wxffc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 725ms (725ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-844c8bbcf4-46cp6

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-844c8bbcf4

SuccessfulDelete

Deleted pod: authorino-844c8bbcf4-46cp6
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-844c8bbcf4 from 1 to 0
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vbklx

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-v8xs6

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-v8xs6

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vbklx

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-2hjgz

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-5krd5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-hl5zf

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-4ln46

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5krd5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5krd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-hl5zf

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2hjgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2hjgz

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-2hjgz

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2hjgz

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hl5zf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5krd5

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-5krd5

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-4ln46

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hl5zf

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hl5zf

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5krd5

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hl5zf

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hl5zf

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5krd5

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2hjgz

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2hjgz

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-70374d4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-70374d4e

openshift-ingress

replicaset-controller

e2e-ait-70374d4e-openshift-default-b455f5bd5

SuccessfulCreate

Created pod: e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

openshift-ingress

multus

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9

SuccessfulCreate

Created pod: e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

openshift-ingress

deployment-controller

e2e-ait-70374d4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-70374d4e-openshift-default-b455f5bd5 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-2ffc2a58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2ffc2a58-openshift-default-6b69db958c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-2ffc2a58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2ffc2a58

openshift-ingress

multus

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-6233a0dd-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-6233a0dd-gw

openshift-ingress

replicaset-controller

e2e-ait-2ffc2a58-openshift-default-6b69db958c

SuccessfulCreate

Created pod: e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

openshift-ingress

deployment-controller

e2e-migrate-6233a0dd-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9 from 0 to 1

openshift-ingress

multus

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-4c806f9c-openshift-default-54567cdd67

SuccessfulCreate

Created pod: e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

openshift-ingress

gateway_labeler_controller

e2e-ait-4c806f9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4c806f9c

openshift-ingress

deployment-controller

e2e-ait-4c806f9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4c806f9c-openshift-default-54567cdd67 from 0 to 1

openshift-ingress

multus

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-70374d4e-6f579c8559

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-70374d4e-6f579c8559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-70374d4e: serviceaccount "payload-processing-e2e-ait-70374d4e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-70374d4e-6f579c8559

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-70374d4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-70374d4e-6f579c8559 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-70374d4e-5558c99454

FailedCreate

Error creating: pods "payload-processing-e2e-ait-70374d4e-5558c99454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-70374d4e: serviceaccount "payload-processing-e2e-ait-70374d4e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-70374d4e-5558c99454

SuccessfulCreate

Created pod: payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

openshift-ingress

deployment-controller

payload-processing-e2e-ait-70374d4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-70374d4e-5558c99454 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2ffc2a58-9857b554d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2ffc2a58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2ffc2a58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2ffc2a58-9857b554d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2ffc2a58: serviceaccount "payload-processing-e2e-ait-2ffc2a58" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2ffc2a58-9857b554d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2ffc2a58-9857b554d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2ffc2a58: serviceaccount "payload-processing-e2e-ait-2ffc2a58" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f

SuccessfulCreate

Created pod: e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

openshift-ingress

kubelet

payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6233a0dd-8c6f95df4

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-6233a0dd-8c6f95df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6233a0dd: serviceaccount "payload-processing-e2e-migrate-6233a0dd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-6233a0dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-6233a0dd-55479bf67 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-6cf9ebb1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6cf9ebb1

openshift-ingress

multus

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6233a0dd: serviceaccount "payload-processing-e2e-migrate-6233a0dd" not found

openshift-ingress

deployment-controller

e2e-derive-6cf9ebb1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6233a0dd-8c6f95df4

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-6233a0dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-6233a0dd-8c6f95df4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4c806f9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4c806f9c-7b89fbdffb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4c806f9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.561s (2.561s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.453s (2.454s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.204s (4.204s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.02s (4.02s including waiting). Image size: 125317101 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4c806f9c-7b89fbdffb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn

openshift-ingress

multus

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4c806f9c: serviceaccount "payload-processing-e2e-ait-4c806f9c" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4c806f9c-7b89fbdffb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4c806f9c-7b89fbdffb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4c806f9c: serviceaccount "payload-processing-e2e-ait-4c806f9c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.166s (2.166s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.003s (2.003s including waiting). Image size: 125317101 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6cf9ebb1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6cf9ebb1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6cf9ebb1-7f45694dd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g

openshift-ingress

multus

payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6cf9ebb1: serviceaccount "payload-processing-e2e-derive-6cf9ebb1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6cf9ebb1-7f45694dd

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6cf9ebb1-7f45694dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6cf9ebb1: serviceaccount "payload-processing-e2e-derive-6cf9ebb1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6cf9ebb1-7f45694dd

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6

openshift-ingress

multus

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6

Started

Container started

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6cf9ebb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6cf9ebb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2ffc2a58-7656899dcf-cs2pj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-2ffc2a58-9857b554d-qffqf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2ffc2a58-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-6233a0dd-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-6233a0dd-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-70374d4e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-70374d4e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-2ffc2a58-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c806f9c-57c6d67b55-nkz46

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4c806f9c-7b89fbdffb-vsxsn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4c806f9c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4c806f9c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

Started

Container started

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6cf9ebb1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6cf9ebb1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-6233a0dd-8c6f95df4-jjpk9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6233a0dd-55479bf67-s2rll

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-e3d2ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-e3d2ff

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-2f69c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-2f69c8

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-70374d4e-6f579c8559-xxthz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-70374d4e-5558c99454-p6dl4

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-2ffc2a58-openshift-default-6b69db958c-n2bpq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-6233a0dd-gw-openshift-default-84fc9f8d9-ktxz2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-4c806f9c-openshift-default-54567cdd67-bp85l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-70374d4e-openshift-default-b455f5bd5-h7bn6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-3a61e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-3a61e1

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-176b6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-176b6c

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e3d2ff: serviceaccount "payload-processing-e2e-worker-w2-e3d2ff" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e3d2ff: serviceaccount "payload-processing-e2e-worker-w2-e3d2ff" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-6cf9ebb1-7f45694dd-vd6c6

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-e3d2ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6cf9ebb1-f484d5c67-lwl8g

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-e3d2ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b from 0 to 1

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2f69c8-66755b489d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2f69c8: serviceaccount "payload-processing-e2e-worker-w0-2f69c8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-2f69c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-2f69c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-2f69c8-66755b489d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2f69c8-66755b489d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-2f69c8-66755b489d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2f69c8: serviceaccount "payload-processing-e2e-worker-w0-2f69c8" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3a61e1: serviceaccount "payload-processing-e2e-worker-w4-3a61e1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-3a61e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-3a61e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-3a61e1: serviceaccount "payload-processing-e2e-worker-w4-3a61e1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-176b6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-176b6c: serviceaccount "payload-processing-e2e-worker-w3-176b6c" not found

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-176b6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-c5447d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-c5447d

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-176b6c: serviceaccount "payload-processing-e2e-worker-w3-176b6c" not found

openshift-ingress

multus

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-6cf9ebb1-openshift-default-7c78d64d4f-zklj2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-c5447d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-c5447d: serviceaccount "payload-processing-e2e-worker-w1-c5447d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-c5447d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-c5447d-7bb465d9f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-c5447d: serviceaccount "payload-processing-e2e-worker-w1-c5447d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

Created

Container created

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

Created

Container created

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

Created

Container created

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 3 to 4

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

Started

Container started

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

Created

Container created

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5krd5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-5krd5

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 8 to 7

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 5 to 8

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

Started

Container started

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 4 to 6

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

Started

Container started

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

Started

Container started

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

Created

Container created

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x7)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 2 to 4
(x7)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

Started

Container started

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

Unhealthy

Readiness probe failed: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

ProbeError

Readiness probe error: Get "http://10.134.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Unhealthy

Readiness probe failed: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

ProbeError

Readiness probe error: Get "http://10.132.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 6 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-8eada0cf-openshift-default-685777678f

SuccessfulCreate

Created pod: e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

openshift-ingress

gateway_labeler_controller

e2e-mt-8eada0cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8eada0cf

openshift-ingress

deployment-controller

e2e-mt-8eada0cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8eada0cf-openshift-default-685777678f from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8eada0cf-5884b8bb8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8eada0cf-5884b8bb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8eada0cf: serviceaccount "payload-processing-e2e-mt-8eada0cf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8eada0cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8eada0cf-5884b8bb8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8eada0cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8eada0cf: serviceaccount "payload-processing-e2e-mt-8eada0cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8eada0cf-5884b8bb8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

openshift-ingress

replicaset-controller

e2e-api-a-648892-openshift-default-7c4b976b7

SuccessfulCreate

Created pod: e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-a-648892

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-648892

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-648892-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-648892-openshift-default-7c4b976b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2hjgz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-v8xs6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-2hjgz

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-v8xs6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

ProbeError

Readiness probe error: Get "http://10.132.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

Unhealthy

Readiness probe failed: Get "http://10.132.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-648892-f58f78dd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-648892

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-648892-f58f78dd7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-648892

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-648892-578444d976 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-648892-578444d976

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-648892-578444d976-xxlck
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-648892-578444d976

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-648892-578444d976-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-648892: serviceaccount "payload-processing-e2e-api-a-648892" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-648892-f58f78dd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-648892-f58f78dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-648892: serviceaccount "payload-processing-e2e-api-a-648892" not found

openshift-ingress

deployment-controller

e2e-api-a-ca0df2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ca0df2-openshift-default-5f9dbf8c97 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-648892-578444d976-xxlck

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-648892-578444d976-xxlck

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-ca0df2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ca0df2

openshift-ingress

replicaset-controller

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97

SuccessfulCreate

Created pod: e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

openshift-ingress

multus

payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-648892-578444d976-xxlck

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-648892-578444d976-xxlck

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh

Started

Container started

openshift-ingress

multus

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

Started

Container started

openshift-ingress

multus

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-97vfn

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ca0df2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-97vfn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ca0df2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ca0df2-7d67bcc9bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ca0df2: serviceaccount "payload-processing-e2e-api-a-ca0df2" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ca0df2: serviceaccount "payload-processing-e2e-api-a-ca0df2" not found
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-97vfn

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 5 to 7
(x6)

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-97vfn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-97vfn

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-97vfn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.471s (3.472s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-97vfn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-vbklx

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-97vfn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vbklx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulCreate

Created pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Unhealthy

Readiness probe failed: Get "https://10.132.0.51:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 7 to 9

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

ProbeError

Readiness probe error: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

Unhealthy

Readiness probe failed: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-kg5zv
(x10)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x10)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x11)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x11)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": dial tcp 10.132.0.131:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

Killing

Stopping container istio-proxy
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Unhealthy

Liveness probe failed: Get "https://10.132.0.51:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

Unhealthy

Startup probe failed: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

ProbeError

Startup probe error: Get "http://10.132.0.131:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-kg5zv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

Unhealthy

Readiness probe failed: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

ProbeError

Readiness probe error: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-6c9de5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6c9de5

openshift-ingress

deployment-controller

e2e-api-b-6c9de5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6c9de5-openshift-default-5867c4b699 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-6c9de5-openshift-default-5867c4b699

SuccessfulCreate

Created pod: e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

openshift-ingress

multus

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-fh6qf

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fh6qf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fh6qf

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-fh6qf

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-p6d95

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 3 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-p6d95

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-p6d95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-p6d95

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-p6d95

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fh6qf

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-8k2jx

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

Unhealthy

Startup probe failed: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

ProbeError

Startup probe error: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8eada0cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8eada0cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6c9de5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6c9de5: serviceaccount "payload-processing-e2e-api-b-6c9de5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6c9de5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6c9de5-65c4494864 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6c9de5-65c4494864

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6c9de5-65c4494864

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6c9de5-65c4494864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6c9de5: serviceaccount "payload-processing-e2e-api-b-6c9de5" not found

openshift-ingress

deployment-controller

e2e-api-b-8d1106-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-8d1106-openshift-default-599b8654cf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-8d1106

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-8d1106

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-8d1106-openshift-default-599b8654cf

SuccessfulCreate

Created pod: e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

openshift-ingress

multus

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-p6d95

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-p6d95

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fh6qf

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fh6qf

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-8d1106

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-8d1106-7447558595 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8d1106-78c5b8b468

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-8d1106-78c5b8b468-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8d1106: serviceaccount "payload-processing-e2e-api-b-8d1106" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8d1106-7447558595

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-8d1106-7447558595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8d1106: serviceaccount "payload-processing-e2e-api-b-8d1106" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-8d1106

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-8d1106-78c5b8b468 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8d1106-78c5b8b468

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8d1106-7447558595

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-t2zhx

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-t2zhx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 6 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-t2zhx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-t2zhx

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-5cq5q

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2pgpc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2pgpc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2pgpc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-2pgpc

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-t2zhx

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2pgpc

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-t2zhx

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2pgpc

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

Unhealthy

Startup probe failed: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

ProbeError

Startup probe error: Get "http://10.132.0.134:15021/healthz/ready": dial tcp 10.132.0.134:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-648892-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-648892-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8eada0cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-8eada0cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ca0df2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ca0df2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-648892-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-648892-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ca0df2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ca0df2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-648892-f58f78dd7-xf8xh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-648892-578444d976-xxlck

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6c9de5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6c9de5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ca0df2-57b8bf5d59-tbxzz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ca0df2-7d67bcc9bb-b2brq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8d1106-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8d1106-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6c9de5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6c9de5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8d1106-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8d1106-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-11378-fb8d68

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-11378-fb8d68

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11378-fb8d68

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.993s (1.993s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11378-fb8d68

Created

Container created

opendatahub

kubelet

test-curl-11378-fb8d68

Started

Container started

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11378-fb8d68

Killing

Stopping container test-curl-11378-fb8d68

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-648892-openshift-default-7c4b976b7-hr9wn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-ca0df2-openshift-default-5f9dbf8c97-sfc2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6c9de5-65c4494864-c5fmz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6c9de5-6fbf95ccff-sc8sg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8d1106-7447558595-2fhm8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-8d1106-78c5b8b468-zkwsh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-lp9q6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-9jzlk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

ProbeError

Readiness probe error: Get "http://10.132.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

Unhealthy

Readiness probe failed: Get "http://10.132.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-ipp-a-8de308-openshift-default-75b4598799

SuccessfulCreate

Created pod: e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

openshift-ingress

deployment-controller

e2e-ipp-a-8de308-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8de308-openshift-default-75b4598799 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-77f556d647-k7rc9

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8de308

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8de308

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 9 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k7rc9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k7rc9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k7rc9

Started

Container started

openshift-ingress

multus

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-k7rc9

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8de308: serviceaccount "payload-processing-e2e-ipp-a-8de308" not found

openshift-ingress

kubelet

e2e-api-b-6c9de5-openshift-default-5867c4b699-kb7wn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8de308

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8de308-7699bcfb84 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8de308

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8de308-7699bcfb84

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8de308-7699bcfb84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8de308: serviceaccount "payload-processing-e2e-ipp-a-8de308" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8de308-7699bcfb84

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq

openshift-ingress

replicaset-controller

e2e-ipp-a-c44644-openshift-default-5cbdc5799c

SuccessfulCreate

Created pod: e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

openshift-ingress

deployment-controller

e2e-ipp-a-c44644-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-c44644-openshift-default-5cbdc5799c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-c44644

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c44644

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k7rc9

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k7rc9

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8eada0cf-5884b8bb8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8eada0cf-5884b8bb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8eada0cf: serviceaccount "payload-processing-e2e-mt-8eada0cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8eada0cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8eada0cf: serviceaccount "payload-processing-e2e-mt-8eada0cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8eada0cf-5884b8bb8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8eada0cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8eada0cf-5884b8bb8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c44644

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c44644-58d55657ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c44644

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c44644-7db5575f5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c44644-7db5575f5d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c44644-7db5575f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c44644: serviceaccount "payload-processing-e2e-ipp-a-c44644" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c44644: serviceaccount "payload-processing-e2e-ipp-a-c44644" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c44644-7db5575f5d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-8f40a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8f40a3-openshift-default-ff78d497f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8f40a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8f40a3

openshift-ingress

kubelet

e2e-api-b-8d1106-openshift-default-599b8654cf-z9vlz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-8f40a3-openshift-default-ff78d497f

SuccessfulCreate

Created pod: e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

openshift-ingress

multus

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-fw98g

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fw98g

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-fw98g

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8f40a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8f40a3-575d669ff6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8f40a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8f40a3-575d669ff6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8f40a3-575d669ff6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8f40a3-575d669ff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8f40a3: serviceaccount "payload-processing-e2e-ipp-a-8f40a3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8f40a3: serviceaccount "payload-processing-e2e-ipp-a-8f40a3" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fw98g

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.923s (2.923s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fw98g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fw98g

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fw98g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fw98g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

kubelet

test-curl-11378-ed61b7

Started

Container started

opendatahub

kubelet

test-curl-11378-ed61b7

Created

Container created

opendatahub

multus

test-curl-11378-ed61b7

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11378-ed61b7

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-58fadf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-58fadf-openshift-default-778b9c9669 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-58fadf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-58fadf

openshift-ingress

replicaset-controller

e2e-api-a-58fadf-openshift-default-778b9c9669

SuccessfulCreate

Created pod: e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

opendatahub

kubelet

test-curl-11378-ed61b7

Killing

Stopping container test-curl-11378-ed61b7

openshift-ingress

multus

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c44644-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c44644-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-64d7c7bc75-p4xhw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7699bcfb84-hctsq

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-58fadf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-58fadf-5968d7d495 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-58fadf-7748bcb6d6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-58fadf-7748bcb6d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-58fadf: serviceaccount "payload-processing-e2e-api-a-58fadf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-58fadf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-58fadf-7748bcb6d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-58fadf-7748bcb6d6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-58fadf-5968d7d495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-58fadf-5968d7d495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-58fadf: serviceaccount "payload-processing-e2e-api-a-58fadf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-58fadf-5968d7d495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9

openshift-ingress

kubelet

payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8eada0cf-7c5b9fd4ff-jn6vv

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8de308-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-ipp-a-8de308-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8de308-openshift-default-75b4598799 from 1 to 3

openshift-ingress

kubelet

payload-processing-e2e-mt-8eada0cf-5884b8bb8-fh7m4

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-8de308-openshift-default-75b4598799

SuccessfulCreate

Created pod: e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

openshift-ingress

replicaset-controller

e2e-ipp-a-8de308-openshift-default-75b4598799

SuccessfulCreate

Created pod: e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

Started

Container started

openshift-ingress

multus

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

Unhealthy

Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

ProbeError

Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8f40a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8f40a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8de308

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8de308-7b79454f5d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8de308

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8de308-7b79454f5d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8de308-7b79454f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8de308: serviceaccount "payload-processing-e2e-ipp-a-8de308" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8de308: serviceaccount "payload-processing-e2e-ipp-a-8de308" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8de308-7b79454f5d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.165s (2.165s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-58d55657ff-tghrj

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.109:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7db5575f5d-qzlhc

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.108:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.256s (3.256s including waiting). Image size: 166612641 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8de308-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8de308-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-68bb7574dc-mdb4m

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c44644-7d496775cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-c44644-7d496775cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c44644: serviceaccount "payload-processing-e2e-ipp-a-c44644" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-c44644

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-c44644-76499c9b99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-c44644

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-c44644-7d496775cb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c44644: serviceaccount "payload-processing-e2e-ipp-a-c44644" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-575d669ff6-pjwxp

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-c44644-7d496775cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r

openshift-ingress

multus

payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-b-cbe974-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-cbe974-openshift-default-69dc69ff6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f

SuccessfulCreate

Created pod: e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-cbe974

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-cbe974

openshift-ingress

multus

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

ProbeError

Startup probe error: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

Unhealthy

Startup probe failed: Get "http://10.133.0.106:15021/healthz/ready": dial tcp 10.133.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8de308-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8de308-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cbe974

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cbe974-b85c966d6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbe974-b85c966d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cbe974-b85c966d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbe974: serviceaccount "payload-processing-e2e-ipp-b-cbe974" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cbe974

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbe974: serviceaccount "payload-processing-e2e-ipp-b-cbe974" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbe974-b85c966d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8f40a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8f40a3-dcc45f766 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8f40a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8f40a3-dcc45f766

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8f40a3-dcc45f766

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8f40a3-dcc45f766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8f40a3: serviceaccount "payload-processing-e2e-ipp-a-8f40a3" not found

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-962e2e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-962e2e
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8f40a3: serviceaccount "payload-processing-e2e-ipp-a-8f40a3" not found

openshift-ingress

deployment-controller

e2e-ipp-b-962e2e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-962e2e-openshift-default-746cc469ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8

openshift-ingress

replicaset-controller

e2e-ipp-b-962e2e-openshift-default-746cc469ff

SuccessfulCreate

Created pod: e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw

Created

Container created

openshift-ingress

multus

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-9371b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9371b7

openshift-ingress

multus

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-9371b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9371b7-openshift-default-7cc8c5668f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-9371b7-openshift-default-7cc8c5668f

SuccessfulCreate

Created pod: e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-962e2e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-962e2e-76469968d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-962e2e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-962e2e-756c88587b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-962e2e: serviceaccount "payload-processing-e2e-ipp-b-962e2e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-962e2e-756c88587b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-962e2e-756c88587b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-962e2e-756c88587b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-962e2e: serviceaccount "payload-processing-e2e-ipp-b-962e2e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9371b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9371b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9371b7-789f894498 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9371b7: serviceaccount "payload-processing-e2e-api-b-9371b7" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9371b7-789f894498

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9371b7-789f894498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9371b7: serviceaccount "payload-processing-e2e-api-b-9371b7" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9371b7-789f894498

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9371b7-789f894498-rb2gj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-api-b-9371b7-789f894498-rb2gj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-9371b7-789f894498-rb2gj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-9371b7-789f894498-rb2gj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-9371b7-789f894498-rb2gj

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.126s (2.126s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8f40a3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8f40a3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-356553

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-356553

openshift-ingress

deployment-controller

e2e-ipp-b-356553-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-356553-openshift-default-766c847c47 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-356553-openshift-default-766c847c47

SuccessfulCreate

Created pod: e2e-ipp-b-356553-openshift-default-766c847c47-482qh

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9371b7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9371b7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-356553-54cf695556

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-356553-54cf695556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-356553: serviceaccount "payload-processing-e2e-ipp-b-356553" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-356553

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-356553-54cf695556 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-356553-54cf695556

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-356553-54cf695556-7vstx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-356553

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-356553-658d75b4cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-356553: serviceaccount "payload-processing-e2e-ipp-b-356553" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-54cf695556-7vstx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-54cf695556-7vstx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-54cf695556-7vstx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-356553-54cf695556-7vstx

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c44644-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-c44644-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-8eada0cf-openshift-default-685777678f-9x9hb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-4fc2e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4fc2e2

openshift-ingress

replicaset-controller

e2e-api-a-4fc2e2-openshift-default-8df6c4b49

SuccessfulCreate

Created pod: e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

openshift-ingress

deployment-controller

e2e-api-a-4fc2e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4fc2e2-openshift-default-8df6c4b49 from 0 to 1

openshift-ingress

multus

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

Unhealthy

Readiness probe failed: Get "http://10.132.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

ProbeError

Readiness probe error: Get "http://10.132.0.152:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4fc2e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4fc2e2: serviceaccount "payload-processing-e2e-api-a-4fc2e2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4fc2e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4fc2e2-84855487c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4fc2e2-84855487c8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4fc2e2-84855487c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4fc2e2: serviceaccount "payload-processing-e2e-api-a-4fc2e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4fc2e2-84855487c8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-d65fcff9-6hvv7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-b85c966d6-6fqhj

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

ProbeError

Startup probe error: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

Unhealthy

Startup probe failed: Get "http://10.132.0.152:15021/healthz/ready": dial tcp 10.132.0.152:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbe974-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbe974-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-756c88587b-dnvhs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-76469968d7-bx7fz

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-58fadf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-58fadf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9371b7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-b-9371b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9371b7-openshift-default-7cc8c5668f from 1 to 2
(x2)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

Created

Container created

openshift-ingress

multus

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-9371b7-openshift-default-7cc8c5668f

SuccessfulCreate

Created pod: e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

Started

Container started

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbe974-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-cbe974-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbe974: serviceaccount "payload-processing-e2e-ipp-b-cbe974" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cbe974

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cbe974

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cbe974-86947478d7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cbe974: serviceaccount "payload-processing-e2e-ipp-b-cbe974" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-58fadf-7748bcb6d6-9pwn4

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-58fadf-5968d7d495-gprm9

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-658d75b4cf-bvlnt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-54cf695556-7vstx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9371b7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9371b7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Unhealthy

Readiness probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

ProbeError

Readiness probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 9 to 7

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gtnhf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ds6kc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-q47mr

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-wqc6m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-7ld7b

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-962e2e: serviceaccount "payload-processing-e2e-ipp-b-962e2e" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-962e2e-7f64d7567d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-962e2e-7f64d7567d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-962e2e: serviceaccount "payload-processing-e2e-ipp-b-962e2e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-962e2e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-962e2e-7f64d7567d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-962e2e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-962e2e-7f64d7567d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm

openshift-ingress

multus

payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-4vrpj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Unhealthy

Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

ProbeError

Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-356553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-356553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-962e2e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-962e2e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-b-5491bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-5491bf

openshift-ingress

deployment-controller

e2e-api-b-5491bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-5491bf-openshift-default-7fd7896757 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-5491bf-openshift-default-7fd7896757

SuccessfulCreate

Created pod: e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-356553: serviceaccount "payload-processing-e2e-ipp-b-356553" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-356553

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-356553-55d49b5bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-356553

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-356553-5f76957cdb from 0 to 1

openshift-ingress

multus

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-356553-5f76957cdb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-356553-5f76957cdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-356553: serviceaccount "payload-processing-e2e-ipp-b-356553" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt
(x5)

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-356553-5f76957cdb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5491bf: serviceaccount "payload-processing-e2e-api-b-5491bf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-5491bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-5491bf-769f566db6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-5491bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5491bf-769f566db6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-5491bf-769f566db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5491bf: serviceaccount "payload-processing-e2e-api-b-5491bf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5491bf-769f566db6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj

openshift-ingress

kubelet

payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-6jtcm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2n4zc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-7blzq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-qzwf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-kvrgm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8de308-7b79454f5d-w8kbm

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-dtbb4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-zbdjh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8de308-bcbcc946c-hrwsl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-7s547

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 10 to 6

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-lzkkn

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-g6n25

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-pc2gc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtv4t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kzf5s

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-356553-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-356553-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4fc2e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4fc2e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-lzq6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-d6gzc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-8de308-openshift-default-75b4598799-45qh8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-58fadf-openshift-default-778b9c9669-clb5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8f40a3-dcc45f766-4h6mw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8f40a3-84f8df4f47-6p5c8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-c44644-76499c9b99-ld6jd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-c44644-7d496775cb-78w6r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-c44644-openshift-default-5cbdc5799c-pmljc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-8f40a3-openshift-default-ff78d497f-sqr9p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9371b7-7c86bbc6c-mq9mt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9371b7-789f894498-rb2gj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cbe974-86947478d7-f4rmw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cbe974-6d74bdc9f6-w4szp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-cbe974-openshift-default-69dc69ff6f-7w7zd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-c9232f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c9232f-openshift-default-85dfbb8d97 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c9232f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c9232f

openshift-ingress

replicaset-controller

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97

SuccessfulCreate

Created pod: e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

openshift-ingress

multus

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-962e2e-5788599b6c-96x72

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-962e2e-7f64d7567d-h86tm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c9232f: serviceaccount "payload-processing-e2e-praxis-a-c9232f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c9232f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c9232f-7949fb67d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c9232f-7949fb67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c9232f: serviceaccount "payload-processing-e2e-praxis-a-c9232f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c9232f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c9232f-7949fb67d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6
(x2)

openshift-ingress

kubelet

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c9232f-7949fb67d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-962e2e-openshift-default-746cc469ff-vfd8f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-19a563-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-19a563-openshift-default-6d97cdb7d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9

SuccessfulCreate

Created pod: e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-356553-5f76957cdb-tr5vz

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-19a563

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-19a563

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-356553-55d49b5bc-z6zdt

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused

openshift-ingress

multus

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-19a563-6467c595c4

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-19a563-6467c595c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-19a563: serviceaccount "payload-processing-e2e-praxis-a-19a563" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-19a563

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-19a563-6467c595c4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-19a563

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-19a563: serviceaccount "payload-processing-e2e-praxis-a-19a563" not found

openshift-ingress

multus

payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr

openshift-ingress

kubelet

payload-processing-e2e-api-a-4fc2e2-84855487c8-46cpz

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-19a563-6467c595c4

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4fc2e2-7b997445f5-l2n9x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5491bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5491bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-praxis-a-20f71c-openshift-default-fc6f649b5

SuccessfulCreate

Created pod: e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-20f71c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-20f71c

openshift-ingress

deployment-controller

e2e-praxis-a-20f71c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-20f71c-openshift-default-fc6f649b5 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-356553-openshift-default-766c847c47-482qh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-p66wz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-9371b7-openshift-default-7cc8c5668f-6fr4j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c

SuccessfulCreate

Created pod: e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

openshift-ingress

deployment-controller

e2e-ipp-a-9d39c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9d39c0-openshift-default-bbd66d6c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9d39c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9d39c0

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

openshift-ingress

multus

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-20f71c: serviceaccount "payload-processing-e2e-praxis-a-20f71c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-20f71c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-20f71c-6988847554 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-20f71c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-20f71c-6988847554

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-20f71c-6988847554

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-20f71c-6988847554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-20f71c: serviceaccount "payload-processing-e2e-praxis-a-20f71c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c9232f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c9232f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9d39c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9d39c0: serviceaccount "payload-processing-e2e-ipp-a-9d39c0" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9d39c0: serviceaccount "payload-processing-e2e-ipp-a-9d39c0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9d39c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5491bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-5491bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-d95d35-openshift-default-7684d6f869

SuccessfulCreate

Created pod: e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

openshift-ingress

deployment-controller

e2e-praxis-b-d95d35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-d95d35-openshift-default-7684d6f869 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-d95d35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-d95d35
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d95d35-88b87698

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-d95d35-88b87698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d95d35: serviceaccount "payload-processing-e2e-praxis-b-d95d35" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d95d35: serviceaccount "payload-processing-e2e-praxis-b-d95d35" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-d95d35

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-d95d35-88b87698 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d95d35-88b87698

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-d95d35

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-4fc2e2-openshift-default-8df6c4b49-2xtvm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445

SuccessfulCreate

Created pod: e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-d3de9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-d3de9d

openshift-ingress

deployment-controller

e2e-praxis-b-d3de9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-d3de9d-openshift-default-84f8bd4445 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5491bf-595b9bf4f9-jdkll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5491bf-769f566db6-zq5jj

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d3de9d: serviceaccount "payload-processing-e2e-praxis-b-d3de9d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-d3de9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d3de9d-798f5684bd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-d3de9d-798f5684bd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-d3de9d-798f5684bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-d3de9d: serviceaccount "payload-processing-e2e-praxis-b-d3de9d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-d3de9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-d3de9d-798f5684bd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-cbd96e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-cbd96e

openshift-ingress

replicaset-controller

e2e-praxis-b-cbd96e-openshift-default-6f77777c49

SuccessfulCreate

Created pod: e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

openshift-ingress

deployment-controller

e2e-praxis-b-cbd96e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-cbd96e-openshift-default-6f77777c49 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-cbd96e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-cbd96e-7676b698d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cbd96e-7676b698d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-cbd96e-7676b698d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cbd96e: serviceaccount "payload-processing-e2e-praxis-b-cbd96e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-cbd96e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cbd96e-7676b698d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cbd96e: serviceaccount "payload-processing-e2e-praxis-b-cbd96e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c9232f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c9232f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-5df65f6dd4-t7xwh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-51e091-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-51e091-openshift-default-6d6d66f5f9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-51e091

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-51e091

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-6f7c96b4cf-g5vh7

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9

SuccessfulCreate

Created pod: e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

openshift-ingress

multus

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-51e091: serviceaccount "payload-processing-e2e-ipp-b-51e091" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-51e091

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-51e091-7956b856cb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-51e091-7956b856cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-51e091-7956b856cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-51e091-7956b856cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-51e091: serviceaccount "payload-processing-e2e-ipp-b-51e091" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-51e091

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-51e091-5f4b488499 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9d39c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9d39c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

Unhealthy

Startup probe failed: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

ProbeError

Startup probe error: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

ProbeError

Startup probe error: Get "http://10.132.0.181:15021/healthz/ready": dial tcp 10.132.0.181:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

Unhealthy

Startup probe failed: Get "http://10.132.0.180:15021/healthz/ready": dial tcp 10.132.0.180:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-2jsfh

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k7rc9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-fh6qf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-k7rc9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-2pgpc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-2pgpc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-fh6qf

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9d39c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9d39c0-648d978b78 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9d39c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9d39c0-648d978b78

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9d39c0: serviceaccount "payload-processing-e2e-ipp-a-9d39c0" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9d39c0-648d978b78

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9d39c0-648d978b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9d39c0: serviceaccount "payload-processing-e2e-ipp-a-9d39c0" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-20f71c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-20f71c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x

Started

Container started
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-19a563-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-19a563-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-b-d3de9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-d3de9d-openshift-default-84f8bd4445 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d3de9d-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9d39c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-9d39c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445

SuccessfulCreate

Created pod: e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

openshift-ingress

replicaset-controller

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445

SuccessfulCreate

Created pod: e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

Started

Container started

openshift-ingress

multus

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

ProbeError

Readiness probe error: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

Unhealthy

Readiness probe failed: Get "http://10.132.0.184:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

Unhealthy

Readiness probe failed: Get "http://10.132.0.186:15021/healthz/ready": read tcp 10.132.0.2:59494->10.132.0.186:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

ProbeError

Readiness probe error: Get "http://10.132.0.186:15021/healthz/ready": read tcp 10.132.0.2:59494->10.132.0.186:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-5491bf-openshift-default-7fd7896757-j25wb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-20f71c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-20f71c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7

SuccessfulCreate

Created pod: e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d87c85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d87c85

openshift-ingress

deployment-controller

e2e-ipp-a-d87c85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

Unhealthy

Startup probe failed: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

ProbeError

Startup probe error: Get "http://10.132.0.184:15021/healthz/ready": dial tcp 10.132.0.184:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d95d35-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d95d35-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d3de9d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d3de9d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d87c85-75b5984778

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d87c85-75b5984778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d87c85: serviceaccount "payload-processing-e2e-ipp-a-d87c85" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d87c85-75b5984778

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d87c85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d87c85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d87c85-75b5984778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d87c85: serviceaccount "payload-processing-e2e-ipp-a-d87c85" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-19a563-7ccb67fc55-7wnlr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-19a563-6467c595c4-z2lzf

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.178:50052" within 1s: context deadline exceeded
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d95d35-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-d95d35-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-20f71c-6988847554-ld88l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-5f4b488499-clrjg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-7956b856cb-qfl8z

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

ProbeError

Startup probe error: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

Unhealthy

Startup probe failed: Get "http://10.132.0.188:15021/healthz/ready": dial tcp 10.132.0.188:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-20f71c-645d97fb95-c5wrx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.135:50052" within 1s: context deadline exceeded
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

Unhealthy

Startup probe failed: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

ProbeError

Startup probe error: Get "http://10.132.0.187:15021/healthz/ready": dial tcp 10.132.0.187:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d87c85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d87c85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cbd96e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cbd96e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-51e091-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-51e091-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-19a563-openshift-default-6d97cdb7d9-hkpjn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-51e091

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-51e091

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-51e091-769f5d944b from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-51e091-769f5d944b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-51e091-769f5d944b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-51e091: serviceaccount "payload-processing-e2e-ipp-b-51e091" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-51e091-769f5d944b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-51e091: serviceaccount "payload-processing-e2e-ipp-b-51e091" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

Unhealthy

Readiness probe failed: Get "http://10.132.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

ProbeError

Readiness probe error: Get "http://10.132.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d3de9d-798f5684bd-t5k56

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d3de9d-6c6b4db5d7-jt9hq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-20f71c-openshift-default-fc6f649b5-qvxgh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-51e091-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-51e091-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-15e1cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-15e1cc
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-75b5984778-bpxt6

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-15e1cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7

SuccessfulCreate

Created pod: e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5d8c96c5-fm4dg

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cbd96e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cbd96e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-15e1cc: serviceaccount "payload-processing-e2e-ipp-b-15e1cc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-15e1cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-15e1cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-15e1cc: serviceaccount "payload-processing-e2e-ipp-b-15e1cc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cbd96e-7676b698d-wmn22

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cbd96e-57f74fdfd7-sfwvt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d87c85-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d87c85-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d87c85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d87c85: serviceaccount "payload-processing-e2e-ipp-a-d87c85" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d87c85: serviceaccount "payload-processing-e2e-ipp-a-d87c85" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d87c85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-xjmnc

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-2qrrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-d3de9d-openshift-default-84f8bd4445-rwqz9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9d39c0-7fc7b8887f-rfr9x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9d39c0-648d978b78-446d4

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-4jmrc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-15e1cc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-15e1cc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-9d39c0-openshift-default-bbd66d6c-s9bln

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tfjjr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-b-cbd96e-openshift-default-6f77777c49-58frk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-rm2bw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-nj5dd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-674c7798f9-9vpwd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-645f5cbbc4-j4j7f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-51e091-54f95fbdcf-lpl7d

Unhealthy

Readiness probe failed: dial tcp 10.133.0.154:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-51e091-769f5d944b-dgc2p

Unhealthy

Readiness probe failed: dial tcp 10.133.0.153:9004: i/o timeout
(x5)

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

Unhealthy

Startup probe failed: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

ProbeError

Startup probe error: Get "http://10.132.0.193:15021/healthz/ready": dial tcp 10.132.0.193:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c9232f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-c9232f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c9232f-openshift-default-85dfbb8d97 from 1 to 2

openshift-ingress

replicaset-controller

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97

SuccessfulCreate

Created pod: e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulCreate

Created pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

Created

Container created

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

Started

Container started

openshift-ingress

multus

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

AddedInterface

Add eth0 [10.133.0.157/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 5 to 4

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-k6rbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-eff9fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-eff9fd

openshift-ingress

deployment-controller

e2e-praxis-a-eff9fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-eff9fd-openshift-default-57db6b7d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5

SuccessfulCreate

Created pod: e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-51e091-openshift-default-6d6d66f5f9-gh45k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-15e1cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

ProbeError

Startup probe error: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-15e1cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-15e1cc-c988685bd from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

Unhealthy

Startup probe failed: Get "http://10.133.0.157:15021/healthz/ready": dial tcp 10.133.0.157:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-15e1cc-c988685bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-dmmw5

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-15e1cc-c988685bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-15e1cc-c988685bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-15e1cc: serviceaccount "payload-processing-e2e-ipp-b-15e1cc" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kn2tb
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-15e1cc: serviceaccount "payload-processing-e2e-ipp-b-15e1cc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

Unhealthy

Startup probe failed: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

ProbeError

Startup probe error: Get "http://10.132.0.199:15021/healthz/ready": dial tcp 10.132.0.199:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r

AddedInterface

Add eth0 [10.133.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

ProbeError

Startup probe error: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

Unhealthy

Startup probe failed: Get "http://10.132.0.200:15021/healthz/ready": dial tcp 10.132.0.200:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-eff9fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-eff9fd-6b784dd94d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-eff9fd: serviceaccount "payload-processing-e2e-praxis-a-eff9fd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-eff9fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-eff9fd: serviceaccount "payload-processing-e2e-praxis-a-eff9fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c9232f-59b86dfc9f-wngf6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c9232f-7949fb67d-bb8hq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-15e1cc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-15e1cc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-mf8c8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

Created

Container created

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

AddedInterface

Add eth0 [10.133.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

Unhealthy

Startup probe failed: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

Unhealthy

Startup probe failed: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

ProbeError

Startup probe error: Get "http://10.132.0.208:15021/healthz/ready": dial tcp 10.132.0.208:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

Unhealthy

Startup probe failed: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

ProbeError

Startup probe error: Get "http://10.133.0.169:15021/healthz/ready": dial tcp 10.133.0.169:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

ProbeError

Startup probe error: Get "http://10.132.0.210:15021/healthz/ready": dial tcp 10.132.0.210:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-066f95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-066f95

openshift-ingress

multus

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-066f95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-066f95-openshift-default-7fd777976f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-066f95-openshift-default-7fd777976f

SuccessfulCreate

Created pod: e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulCreate

Created pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-066f95-5476fdb77d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-066f95-5476fdb77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-066f95: serviceaccount "payload-processing-e2e-praxis-b-066f95" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-066f95: serviceaccount "payload-processing-e2e-praxis-b-066f95" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-066f95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-066f95-68968b4fff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-066f95-5476fdb77d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-066f95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-066f95-5476fdb77d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

Unhealthy

Startup probe failed: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

ProbeError

Startup probe error: Get "http://10.132.0.211:15021/healthz/ready": dial tcp 10.132.0.211:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eff9fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eff9fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-066f95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-066f95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-w9v6c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-c9232f-openshift-default-85dfbb8d97-q4zkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

ProbeError

Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-d95d35-f67b6f879-pdc6f

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

Unhealthy

Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-d95d35-88b87698-5msxx

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eff9fd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-eff9fd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-eff9fd-847fb7448c-5n9rh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-eff9fd-6b784dd94d-lrzsf

Killing

Stopping container payload-processing

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Unhealthy

Liveness probe failed: Get "https://10.132.0.51:8000/health": context deadline exceeded

openshift-ingress

kubelet

e2e-praxis-b-d95d35-openshift-default-7684d6f869-9bkhh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-19c94a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-19c94a

openshift-ingress

replicaset-controller

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f

SuccessfulCreate

Created pod: e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-066f95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-066f95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-a-w4-19c94a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-19c94a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-19c94a-69db9c4498 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-19c94a: serviceaccount "payload-processing-e2e-shared-a-w4-19c94a" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-19c94a: serviceaccount "payload-processing-e2e-shared-a-w4-19c94a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-19c94a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-eff9fd-openshift-default-57db6b7d5-287bj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-fw98g

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-fw98g

Killing

Stopping container discovery

openshift-ingress

deployment-controller

e2e-ipp-a-d87c85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7

SuccessfulCreate

Created pod: e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d87c85-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-fc7ee7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-fc7ee7

openshift-ingress

multus

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-a-w1-fc7ee7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7

SuccessfulCreate

Created pod: e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

openshift-ingress

multus

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-066f95-5476fdb77d-dbq5t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-066f95-68968b4fff-r99ql

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-a-w2-fb1a2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf

SuccessfulCreate

Created pod: e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-fc7ee7: serviceaccount "payload-processing-e2e-shared-a-w1-fc7ee7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-fc7ee7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-fc7ee7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-fb1a2a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-fb1a2a
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-fc7ee7: serviceaccount "payload-processing-e2e-shared-a-w1-fc7ee7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulCreate

Created pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-fb1a2a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fb1a2a: serviceaccount "payload-processing-e2e-shared-a-w2-fb1a2a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fb1a2a: serviceaccount "payload-processing-e2e-shared-a-w2-fb1a2a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-fb1a2a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-19c94a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-19c94a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d87c85-6bfc9c74dd-wrpj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d87c85-5584478bcf-6nr6m

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

ProbeError

Startup probe error: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

ProbeError

Startup probe error: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

Unhealthy

Startup probe failed: Get "http://10.133.0.177:15021/healthz/ready": dial tcp 10.133.0.177:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

Unhealthy

Startup probe failed: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

Unhealthy

Readiness probe failed: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-066f95-openshift-default-7fd777976f-zdlz2

ProbeError

Readiness probe error: Get "http://10.133.0.170:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7

SuccessfulCreate

Created pod: e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-7c88ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-7c88ae

openshift-ingress

deployment-controller

e2e-shared-b-w4-7c88ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-t2zhx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-t2zhx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-5cq5q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 7 to 5

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-7c88ae: serviceaccount "payload-processing-e2e-shared-b-w4-7c88ae" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-7c88ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-7c88ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-7c88ae-b5798c666 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-7c88ae: serviceaccount "payload-processing-e2e-shared-b-w4-7c88ae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

Unhealthy

Readiness probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

ProbeError

Readiness probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-304459

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-304459

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulCreate

Created pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

openshift-ingress

deployment-controller

e2e-shared-a-w3-304459-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-304459-openshift-default-6885974d55 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

AddedInterface

Add eth0 [10.132.0.221/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fb1a2a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fb1a2a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-304459-d7b764864

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-304459: serviceaccount "payload-processing-e2e-shared-a-w3-304459" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-304459

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-304459-d7b764864 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-304459-d7b764864

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-304459-d7b764864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-304459: serviceaccount "payload-processing-e2e-shared-a-w3-304459" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-304459

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-aa2fdf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855

SuccessfulCreate

Created pod: e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-aa2fdf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-aa2fdf

openshift-ingress

multus

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-aa2fdf: serviceaccount "payload-processing-e2e-shared-b-w1-aa2fdf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-aa2fdf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-aa2fdf: serviceaccount "payload-processing-e2e-shared-b-w1-aa2fdf" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-0dc148

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-0dc148

openshift-ingress

deployment-controller

e2e-shared-b-w2-0dc148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-0dc148-openshift-default-5868c4797 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-0dc148-openshift-default-5868c4797

SuccessfulCreate

Created pod: e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-aa2fdf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

Started

Container started

openshift-ingress

multus

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

Unhealthy

Readiness probe failed: Get "http://10.134.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

ProbeError

Readiness probe error: Get "http://10.134.0.120:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-0dc148

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0dc148: serviceaccount "payload-processing-e2e-shared-b-w2-0dc148" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-0dc148

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0dc148: serviceaccount "payload-processing-e2e-shared-b-w2-0dc148" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-fc7ee7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-fc7ee7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

ProbeError

Startup probe error: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

Unhealthy

Startup probe failed: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-7rspf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-d87c85-openshift-default-dfd7d8cc7-48d28

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-19c94a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-19c94a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fb1a2a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fb1a2a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

Unhealthy

Startup probe failed: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

ProbeError

Startup probe error: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7c88ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7c88ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-7a213d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-7a213d

openshift-ingress

deployment-controller

e2e-shared-b-w3-7a213d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-7a213d-openshift-default-b7b455459 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-7a213d-openshift-default-b7b455459

SuccessfulCreate

Created pod: e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7a213d: serviceaccount "payload-processing-e2e-shared-b-w3-7a213d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-7a213d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-fc7ee7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7a213d: serviceaccount "payload-processing-e2e-shared-b-w3-7a213d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-7a213d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-fc7ee7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulCreate

Created pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulCreate

Created pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

openshift-ingress

deployment-controller

e2e-shared-a-w3-304459-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-304459-openshift-default-6885974d55 from 1 to 4

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulCreate

Created pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Unhealthy

Readiness probe failed: Get "http://10.133.0.180:15021/healthz/ready": read tcp 10.133.0.2:49340->10.133.0.180:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

ProbeError

Readiness probe error: Get "http://10.133.0.180:15021/healthz/ready": read tcp 10.133.0.2:49340->10.133.0.180:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

AddedInterface

Add eth0 [10.132.0.227/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

Created

Container created

openshift-ingress

multus

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

Started

Container started

openshift-ingress

multus

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7c88ae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-7c88ae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-15e1cc-79d76cd75-hkf2r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-15e1cc-c988685bd-6z7kz

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

Unhealthy

Startup probe failed: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

ProbeError

Startup probe error: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

Unhealthy

Startup probe failed: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

Unhealthy

Startup probe failed: Get "http://10.132.0.227:15021/healthz/ready": dial tcp 10.132.0.227:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

ProbeError

Startup probe error: Get "http://10.133.0.185:15021/healthz/ready": dial tcp 10.133.0.185:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

ProbeError

Startup probe error: Get "http://10.132.0.227:15021/healthz/ready": dial tcp 10.132.0.227:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-aa2fdf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-aa2fdf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-1413c8-openshift-default-5b8788488f

SuccessfulCreate

Created pod: e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

openshift-ingress

multus

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-1413c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-1413c8

openshift-ingress

deployment-controller

e2e-explicit-1413c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-1413c8-openshift-default-5b8788488f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-15e1cc-openshift-default-6f756dc5f7-6zfzm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-1413c8-76f699c45f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-1413c8-76f699c45f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-1413c8: serviceaccount "payload-processing-e2e-explicit-1413c8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-1413c8-76f699c45f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-1413c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-1413c8-76f699c45f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-1413c8-6d66d75c58

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-1413c8-6d66d75c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-1413c8: serviceaccount "payload-processing-e2e-explicit-1413c8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-1413c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-1413c8-6d66d75c58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-1413c8-6d66d75c58

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq

openshift-ingress

multus

payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt

AddedInterface

Add eth0 [10.133.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-npnjc

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-ldx9g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-aa2fdf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-aa2fdf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w3-304459-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-304459-openshift-default-6885974d55 from 4 to 6

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulCreate

Created pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulCreate

Created pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

Started

Container started

openshift-ingress

multus

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-p6d95

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

ProbeError

Readiness probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

Unhealthy

Readiness probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7a213d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7a213d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

ProbeError

Startup probe error: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

Unhealthy

Startup probe failed: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7a213d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-7a213d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-1413c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-1413c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

Unhealthy

Startup probe failed: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

ProbeError

Startup probe error: Get "http://10.132.0.223:15021/healthz/ready": dial tcp 10.132.0.223:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-1413c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-1413c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-1413c8-76f699c45f-rv8gt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-1413c8-6d66d75c58-ncqbq

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-0dc148-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-0dc148-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-d3047c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d3047c-openshift-default-cbc4479ff from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-d3047c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d3047c

openshift-ingress

replicaset-controller

e2e-noten-d3047c-openshift-default-cbc4479ff

SuccessfulCreate

Created pod: e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7

openshift-ingress

kubelet

e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-0dc148-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-0dc148-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-1413c8-openshift-default-5b8788488f-9thgz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d3047c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-d3047c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-d3047c-openshift-default-cbc4479ff-bpjn7

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11378-3b28d5

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-11378-3b28d5

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11378-3b28d5

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.072s (2.072s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11378-3b28d5

Started

Container started

opendatahub

kubelet

test-curl-11378-3b28d5

Created

Container created

opendatahub

kubelet

test-curl-11378-3b28d5

Killing

Stopping container test-curl-11378-3b28d5

openshift-ingress

replicaset-controller

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc

SuccessfulCreate

Created pod: e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-8ebd65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-8ebd65

openshift-ingress

deployment-controller

e2e-shared-a-w0-8ebd65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-8ebd65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-8ebd65: serviceaccount "payload-processing-e2e-shared-a-w0-8ebd65" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-8ebd65: serviceaccount "payload-processing-e2e-shared-a-w0-8ebd65" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-8ebd65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-t6n5g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-tf9dk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-pv94v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-kfpz9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

opendatahub

kubelet

test-curl-11390-379eb6

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11390-379eb6

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11390-379eb6

Started

Container started

opendatahub

kubelet

test-curl-11390-379eb6

Created

Container created

opendatahub

kubelet

test-curl-11390-bc19eb

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11390-bc19eb

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11390-bc19eb

Started

Container started

opendatahub

kubelet

test-curl-11390-bc19eb

Created

Container created

opendatahub

kubelet

test-curl-11390-379eb6

Killing

Stopping container test-curl-11390-379eb6

opendatahub

multus

test-curl-11390-c32e14

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11390-c32e14

Created

Container created

opendatahub

kubelet

test-curl-11390-c32e14

Started

Container started

opendatahub

kubelet

test-curl-11390-c32e14

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11390-bc19eb

Killing

Stopping container test-curl-11390-bc19eb

opendatahub

kubelet

test-curl-11390-5c41f2

Started

Container started

opendatahub

kubelet

test-curl-11390-5c41f2

Created

Container created

opendatahub

kubelet

test-curl-11390-5c41f2

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11390-5c41f2

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11390-c32e14

Killing

Stopping container test-curl-11390-c32e14

opendatahub

kubelet

test-curl-11390-7b5a70

Created

Container created

opendatahub

multus

test-curl-11390-7b5a70

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11390-7b5a70

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11390-7b5a70

Started

Container started

opendatahub

kubelet

test-curl-11390-5c41f2

Killing

Stopping container test-curl-11390-5c41f2

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ae795b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ae795b

opendatahub

kubelet

test-curl-11390-7b5a70

Killing

Stopping container test-curl-11390-7b5a70

openshift-ingress

replicaset-controller

e2e-extmod-a-ae795b-openshift-default-5b55749f85

SuccessfulCreate

Created pod: e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

openshift-ingress

deployment-controller

e2e-extmod-a-ae795b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ae795b-openshift-default-5b55749f85 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8ebd65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8ebd65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ae795b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ae795b: serviceaccount "payload-processing-e2e-extmod-a-ae795b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ae795b-7b56f85c86

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ae795b-7b56f85c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ae795b: serviceaccount "payload-processing-e2e-extmod-a-ae795b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ae795b-7b56f85c86

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ae795b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ae795b-7b56f85c86 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-5vtx8

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-hhlrb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-8k2jx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 4 to 3

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-388653

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-388653

openshift-ingress

multus

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w0-388653-openshift-default-6cd774c57f

SuccessfulCreate

Created pod: e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

openshift-ingress

deployment-controller

e2e-shared-b-w0-388653-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-388653-openshift-default-6cd774c57f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-388653

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-388653-576db78cbd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-388653

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-388653-576db78cbd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-388653: serviceaccount "payload-processing-e2e-shared-b-w0-388653" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-388653-576db78cbd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-388653-576db78cbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-388653: serviceaccount "payload-processing-e2e-shared-b-w0-388653" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 10 to 6

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dsxpl

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-9bcnh

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-hrcjh

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-2psl7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855

SuccessfulCreate

Created pod: e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

openshift-ingress

deployment-controller

e2e-shared-b-w1-aa2fdf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-aa2fdf-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9

SuccessfulCreate

Created pod: e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

openshift-ingress

deployment-controller

e2e-extmod-a-881f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-881f83-openshift-default-7f7b84cbd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-881f83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-881f83

openshift-ingress

multus

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

Unhealthy

Startup probe failed: Get "http://10.132.0.241:15021/healthz/ready": dial tcp 10.132.0.241:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

ProbeError

Startup probe error: Get "http://10.132.0.241:15021/healthz/ready": dial tcp 10.132.0.241:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-881f83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-881f83-6b6777d984 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-881f83-c579c5979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-881f83-c579c5979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-881f83: serviceaccount "payload-processing-e2e-extmod-a-881f83" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-881f83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-881f83-c579c5979 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-881f83-6b6777d984

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-881f83-6b6777d984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-881f83: serviceaccount "payload-processing-e2e-extmod-a-881f83" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-gs7bn

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

AddedInterface

Add eth0 [10.133.0.200/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-881f83-6b6777d984

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-881f83-c579c5979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

openshift-ingress

multus

payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

AddedInterface

Add eth0 [10.133.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-zlmzd

openshift-ingress

deployment-controller

e2e-extmod-a-d60c68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d60c68-openshift-default-69c4849ff7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf

SuccessfulDelete

Deleted pod: e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

openshift-ingress

replicaset-controller

e2e-extmod-a-d60c68-openshift-default-69c4849ff7

SuccessfulCreate

Created pod: e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-176b6c-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-176b6c-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf from 3 to 2

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d60c68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d60c68

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-8fgt7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0f6f96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0f6f96

openshift-ingress

deployment-controller

e2e-extmod-b-0f6f96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0f6f96-openshift-default-79d9885d49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-0f6f96-openshift-default-79d9885d49

SuccessfulCreate

Created pod: e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

openshift-ingress

multus

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8ebd65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d60c68-865c467cd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d60c68-865c467cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d60c68: serviceaccount "payload-processing-e2e-extmod-a-d60c68" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d60c68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d60c68: serviceaccount "payload-processing-e2e-extmod-a-d60c68" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-8ebd65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d60c68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d60c68-865c467cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d60c68-865c467cd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

openshift-ingress

multus

payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0f6f96-56498d58d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0f6f96-56498d58d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0f6f96-56498d58d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0f6f96: serviceaccount "payload-processing-e2e-extmod-b-0f6f96" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0f6f96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0f6f96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0f6f96-56498d58d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0f6f96: serviceaccount "payload-processing-e2e-extmod-b-0f6f96" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11387-146e92

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-11387-146e92

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11387-146e92

Created

Container created

opendatahub

kubelet

test-curl-11387-146e92

Started

Container started

opendatahub

kubelet

test-curl-11387-146e92

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 597ms (597ms including waiting). Image size: 106100986 bytes.

openshift-ingress

deployment-controller

e2e-shared-a-w2-fb1a2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-fb1a2a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf

SuccessfulCreate

Created pod: e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

Created

Container created

opendatahub

kubelet

test-curl-11387-146e92

Killing

Stopping container test-curl-11387-146e92
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

Unhealthy

Startup probe failed: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

ProbeError

Startup probe error: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

ProbeError

Startup probe error: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

Unhealthy

Startup probe failed: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a525bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a525bd

openshift-ingress

deployment-controller

e2e-extmod-a-a525bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a525bd-openshift-default-68dcf45b7c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c

SuccessfulCreate

Created pod: e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

openshift-ingress

multus

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a525bd: serviceaccount "payload-processing-e2e-extmod-a-a525bd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a525bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a525bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a525bd: serviceaccount "payload-processing-e2e-extmod-a-a525bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-388653-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-388653-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc

SuccessfulCreate

Created pod: e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

openshift-ingress

gateway_labeler_controller

e2e-autores-6d4b7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-6d4b7a

openshift-ingress

deployment-controller

e2e-autores-6d4b7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-6d4b7a-openshift-default-7bbb88b5dc from 0 to 1

openshift-ingress

multus

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-6d4b7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-6d4b7a-667c9564b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-6d4b7a: serviceaccount "payload-processing-e2e-autores-6d4b7a" not found

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 6 to 4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb

FailedCreate

Error creating: pods "payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-6d4b7a: serviceaccount "payload-processing-e2e-autores-6d4b7a" not found

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-pmm5z

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-tmw9c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-autores-6d4b7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-6d4b7a-57ddcbd6fb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq

openshift-ingress

multus

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb

SuccessfulCreate

Created pod: payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg

openshift-ingress

kubelet

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-77f556d647-4ln46
(x2)

openshift-ingress

kubelet

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d60c68-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d60c68-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-hdphp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-gv9nc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-035d7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-035d7d-openshift-default-8957ffc65 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-388653-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-388653-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-035d7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-035d7d

openshift-ingress

replicaset-controller

e2e-extmod-b-035d7d-openshift-default-8957ffc65

SuccessfulCreate

Created pod: e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-4ln46

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

Unhealthy

Startup probe failed: Get "http://10.132.0.242:15021/healthz/ready": dial tcp 10.132.0.242:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

ProbeError

Startup probe error: Get "http://10.132.0.242:15021/healthz/ready": dial tcp 10.132.0.242:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-881f83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-881f83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

Unhealthy

Startup probe failed: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

ProbeError

Startup probe error: Get "http://10.133.0.199:15021/healthz/ready": dial tcp 10.133.0.199:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-035d7d: serviceaccount "payload-processing-e2e-extmod-b-035d7d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-035d7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-035d7d-7d5b89f7b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-035d7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-035d7d: serviceaccount "payload-processing-e2e-extmod-b-035d7d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a525bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a525bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-3d9b36

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-3d9b36

openshift-ingress

deployment-controller

e2e-extmod-b-3d9b36-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f

SuccessfulCreate

Created pod: e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

openshift-ingress

multus

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-881f83-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-881f83-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-3d9b36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-3d9b36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3d9b36: serviceaccount "payload-processing-e2e-extmod-b-3d9b36" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-3d9b36: serviceaccount "payload-processing-e2e-extmod-b-3d9b36" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d60c68-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d60c68-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

Unhealthy

Startup probe failed: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

ProbeError

Startup probe error: Get "http://10.133.0.208:15021/healthz/ready": dial tcp 10.133.0.208:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c

SuccessfulCreate

Created pod: e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

openshift-ingress

deployment-controller

e2e-extmod-b-f58f32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-f58f32-openshift-default-bd8b77d5c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-f58f32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-f58f32

openshift-ingress

multus

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

AddedInterface

Add eth0 [10.132.0.247/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f58f32-664f5dc478

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f58f32: serviceaccount "payload-processing-e2e-extmod-b-f58f32" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-f58f32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-f58f32-664f5dc478 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f58f32-664f5dc478

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-f58f32-664f5dc478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f58f32: serviceaccount "payload-processing-e2e-extmod-b-f58f32" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

ProbeError

Readiness probe error: Get "http://10.132.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-f58f32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc from 0 to 1

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

Unhealthy

Readiness probe failed: Get "http://10.132.0.244:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a525bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a525bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

Unhealthy

Startup probe failed: Get "http://10.132.0.245:15021/healthz/ready": dial tcp 10.132.0.245:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

Unhealthy

Startup probe failed: Get "http://10.132.0.244:15021/healthz/ready": dial tcp 10.132.0.244:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

ProbeError

Startup probe error: Get "http://10.132.0.244:15021/healthz/ready": dial tcp 10.132.0.244:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

ProbeError

Startup probe error: Get "http://10.132.0.245:15021/healthz/ready": dial tcp 10.132.0.245:15021: connect: connection refused body:
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0f6f96-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0f6f96-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6d4b7a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6d4b7a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-035d7d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-035d7d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6d4b7a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6d4b7a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-035d7d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-035d7d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-6d4b7a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-autores-6d4b7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-6d4b7a-openshift-default-7bbb88b5dc from 1 to 2

openshift-ingress

replicaset-controller

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc

SuccessfulCreate

Created pod: e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

openshift-ingress

multus

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

Started

Container started

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

Created

Container created

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-6d4b7a-57ddcbd6fb-wzqlg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6d4b7a-667c9564b7-bkrxq

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

ProbeError

Startup probe error: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

Unhealthy

Startup probe failed: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3d9b36-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3d9b36-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3d9b36-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-3d9b36-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

ProbeError

Startup probe error: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

Unhealthy

Startup probe failed: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-lbv9m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

Started

Container started

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

ProbeError

Readiness probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-6d4b7a-openshift-default-7bbb88b5dc-9cnhv

Unhealthy

Readiness probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

Unhealthy

Startup probe failed: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

ProbeError

Startup probe error: Get "http://10.132.0.247:15021/healthz/ready": dial tcp 10.132.0.247:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-88cbc7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-88cbc7

openshift-ingress

deployment-controller

e2e-extmod-a-88cbc7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-88cbc7-openshift-default-74778845d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-88cbc7-openshift-default-74778845d9

SuccessfulCreate

Created pod: e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

openshift-ingress

multus

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-88cbc7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-88cbc7-6549889655 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-88cbc7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-88cbc7: serviceaccount "payload-processing-e2e-extmod-a-88cbc7" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-88cbc7: serviceaccount "payload-processing-e2e-extmod-a-88cbc7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ae795b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ae795b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f58f32-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f58f32-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f58f32-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f58f32-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

deployment-controller

e2e-worker-w2-e3d2ff-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-e3d2ff-openshift-default-77d9c5757 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757

SuccessfulDelete

Deleted pod: e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-httjb

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e3d2ff-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-85fdfbb6b6

FailedCreate

Error creating: pods "payload-processing-external-model-85fdfbb6b6-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-85fdfbb6b6

SuccessfulCreate

Created pod: payload-processing-external-model-85fdfbb6b6-vkrhd

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-85fdfbb6b6 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-85fdfbb6b6-vkrhd

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-85fdfbb6b6-vkrhd

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-85fdfbb6b6-vkrhd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-85fdfbb6b6-vkrhd

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-74f944f77 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-74f944f77

SuccessfulCreate

Created pod: payload-processing-external-model-74f944f77-jfq98

models-as-a-service

kubelet

payload-processing-external-model-74f944f77-jfq98

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Unhealthy

Readiness probe failed: Get "http://10.132.0.250:15021/healthz/ready": read tcp 10.132.0.2:38540->10.132.0.250:15021: read: connection reset by peer

models-as-a-service

kubelet

payload-processing-external-model-74f944f77-jfq98

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-d66d22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-d66d22

models-as-a-service

multus

payload-processing-external-model-74f944f77-jfq98

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

ProbeError

Readiness probe error: Get "http://10.132.0.250:15021/healthz/ready": read tcp 10.132.0.2:38540->10.132.0.250:15021: read: connection reset by peer body:

models-as-a-service

kubelet

payload-processing-external-model-74f944f77-jfq98

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 4 to 3
(x2)

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-d66d22-openshift-default-64984c7669

SuccessfulCreate

Created pod: e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

openshift-ingress

multus

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dszbm

openshift-ingress

deployment-controller

e2e-extmod-b-d66d22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d66d22-openshift-default-64984c7669 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d66d22: serviceaccount "payload-processing-e2e-extmod-b-d66d22" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-d66d22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d66d22-7bccc4d786

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d66d22-7bccc4d786

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-d66d22-7bccc4d786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d66d22: serviceaccount "payload-processing-e2e-extmod-b-d66d22" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-d66d22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-d66d22-7bccc4d786 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

Started

Container started
(x5)

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 4 to 3

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

multus

payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

ProbeError

Startup probe error: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Unhealthy

Startup probe failed: Get "http://10.132.0.250:15021/healthz/ready": dial tcp 10.132.0.250:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-85fdfbb6b6-vkrhd

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-85fdfbb6b6

SuccessfulDelete

Deleted pod: payload-processing-external-model-85fdfbb6b6-vkrhd

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-85fdfbb6b6 from 1 to 0

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-vsskx

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-knmrm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-hxpzc

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-hxpzc

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hxpzc

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-knmrm

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hxpzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hxpzc

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hxpzc

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-88cbc7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hxpzc

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-88cbc7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

Unhealthy

Startup probe failed: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

ProbeError

Startup probe error: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 7; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-vnxfr

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-77f556d647-dwcq7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-dwcq7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vnxfr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-dwcq7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-dwcq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-tjlgk

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-tjlgk

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-tjlgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-tjlgk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vnxfr

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-dwcq7

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-vnxfr

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vnxfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vnxfr

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-vnxfr

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-dwcq7

ProbeError

Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-dwcq7

Unhealthy

Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-tjlgk

ProbeError

Startup probe error: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-tjlgk

Unhealthy

Startup probe failed: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-a-w3-304459-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-304459-openshift-default-6885974d55 from 6 to 5

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

Unhealthy

Readiness probe failed: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-hclgn

ProbeError

Readiness probe error: Get "http://10.132.0.221:15021/healthz/ready": dial tcp 10.132.0.221:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Unhealthy

Readiness probe failed: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

ProbeError

Readiness probe error: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Unhealthy

Startup probe failed: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

ProbeError

Startup probe error: Get "http://10.132.0.252:15021/healthz/ready": dial tcp 10.132.0.252:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d66d22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d66d22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d66d22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d66d22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-77f556d647 from 7 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-k5n95

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8mzp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-lpk2w

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-b8mzp

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-77f556d647-lpk2w

AddedInterface

Add eth0 [10.132.1.8/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8mzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8mzp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-lpk2w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k5n95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k5n95

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-lpk2w

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k5n95

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8mzp

ProbeError

Startup probe error: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8mzp

Unhealthy

Startup probe failed: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k5n95

ProbeError

Startup probe error: Get "http://10.134.0.196:15021/healthz/ready": dial tcp 10.134.0.196:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k5n95

Unhealthy

Startup probe failed: Get "http://10.134.0.196:15021/healthz/ready": dial tcp 10.134.0.196:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-lpk2w

Unhealthy

Startup probe failed: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-lpk2w

ProbeError

Startup probe error: Get "http://10.132.1.8:15021/healthz/ready": dial tcp 10.132.1.8:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-58fbcd848f from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-58fbcd848f

SuccessfulCreate

Created pod: payload-processing-external-model-58fbcd848f-ssc8v

models-as-a-service

kubelet

payload-processing-external-model-58fbcd848f-ssc8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-58fbcd848f-ssc8v

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-58fbcd848f-ssc8v

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-58fbcd848f-ssc8v

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-74f944f77-jfq98

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-74f944f77 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-74f944f77

SuccessfulDelete

Deleted pod: payload-processing-external-model-74f944f77-jfq98
(x15)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Unhealthy

Readiness probe failed: Get "https://10.132.0.51:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Unhealthy

Readiness probe failed: Get "https://10.132.0.51:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

models-as-a-service

replicaset-controller

payload-processing-external-model-59686ffd74

SuccessfulCreate

Created pod: payload-processing-external-model-59686ffd74-bpf8q

models-as-a-service

multus

payload-processing-external-model-59686ffd74-bpf8q

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-bpf8q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-bpf8q

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-bpf8q

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-bpf8q

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-59686ffd74

SuccessfulDelete

Deleted pod: payload-processing-external-model-59686ffd74-bpf8q
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-59686ffd74 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-59686ffd74

SuccessfulCreate

Created pod: payload-processing-external-model-59686ffd74-722wt

models-as-a-service

multus

payload-processing-external-model-59686ffd74-722wt

AddedInterface

Add eth0 [10.133.0.237/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-722wt

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-722wt

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-722wt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-59686ffd74 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-59686ffd74-722wt

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-59686ffd74

SuccessfulDelete

Deleted pod: payload-processing-external-model-59686ffd74-722wt

models-as-a-service

kubelet

payload-processing-external-model-7859b55bb7-k5djn

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-7859b55bb7

SuccessfulCreate

Created pod: payload-processing-external-model-7859b55bb7-k5djn

models-as-a-service

kubelet

payload-processing-external-model-7859b55bb7-k5djn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-7859b55bb7-k5djn

Created

Container created

models-as-a-service

multus

payload-processing-external-model-7859b55bb7-k5djn

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7859b55bb7 from 0 to 1

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7859b55bb7 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-7859b55bb7

SuccessfulDelete

Deleted pod: payload-processing-external-model-7859b55bb7-k5djn

models-as-a-service

kubelet

payload-processing-external-model-7859b55bb7-k5djn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-9z6xd
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

models-as-a-service

kubelet

payload-processing-external-model-5fbb64fb6b-mgvv7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5fbb64fb6b-mgvv7

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-5fbb64fb6b

SuccessfulCreate

Created pod: payload-processing-external-model-5fbb64fb6b-mgvv7

openshift-ingress

gateway_labeler_controller

e2e-inf-a-2f6ee2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-2f6ee2

models-as-a-service

kubelet

payload-processing-external-model-5fbb64fb6b-mgvv7

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5fbb64fb6b-mgvv7

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-a-2f6ee2-openshift-default-5c8958659f

SuccessfulCreate

Created pod: e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

openshift-ingress

multus

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-2f6ee2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-2f6ee2-openshift-default-5c8958659f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w3-304459-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-304459-openshift-default-6885974d55 from 5 to 4

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-2f6ee2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-2f6ee2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-2f6ee2-844666dcbd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2f6ee2-844666dcbd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-2f6ee2-844666dcbd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-2f6ee2-844666dcbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2f6ee2: serviceaccount "payload-processing-e2e-inf-a-2f6ee2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-2f6ee2: serviceaccount "payload-processing-e2e-inf-a-2f6ee2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

openshift-ingress

multus

payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf

AddedInterface

Add eth0 [10.133.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-wbtlv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-58fbcd848f

SuccessfulDelete

Deleted pod: payload-processing-external-model-58fbcd848f-ssc8v

models-as-a-service

kubelet

payload-processing-external-model-58fbcd848f-ssc8v

Killing

Stopping container payload-processing
(x12)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ftp6n

Unhealthy

Readiness probe failed: Get "https://10.132.0.51:8000/ready": context deadline exceeded

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

Unhealthy

Readiness probe failed: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

ProbeError

Readiness probe error: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

ProbeError

Startup probe error: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

Unhealthy

Startup probe failed: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2f6ee2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2f6ee2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-b-bdd208

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-bdd208

openshift-ingress

replicaset-controller

e2e-inf-b-bdd208-openshift-default-8f948c485

SuccessfulCreate

Created pod: e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

openshift-ingress

deployment-controller

e2e-inf-b-bdd208-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bdd208-openshift-default-8f948c485 from 0 to 1

openshift-ingress

multus

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-bdd208

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-bdd208-784594d77d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bdd208-784594d77d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bdd208-784594d77d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-bdd208-784594d77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bdd208: serviceaccount "payload-processing-e2e-inf-b-bdd208" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-bdd208

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bdd208: serviceaccount "payload-processing-e2e-inf-b-bdd208" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

AddedInterface

Add eth0 [10.133.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr

AddedInterface

Add eth0 [10.133.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2f6ee2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-2f6ee2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

models-as-a-service

replicaset-controller

payload-processing-external-model-56dc545b7c

SuccessfulCreate

Created pod: payload-processing-external-model-56dc545b7c-d92fs

models-as-a-service

kubelet

payload-processing-external-model-56dc545b7c-d92fs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-56dc545b7c-d92fs

AddedInterface

Add eth0 [10.133.0.245/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-56dc545b7c-d92fs

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-56dc545b7c-d92fs

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-a-82ccfd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-82ccfd

openshift-ingress

deployment-controller

e2e-inf-a-82ccfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-82ccfd-openshift-default-854d9c95f from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-82ccfd-openshift-default-854d9c95f

SuccessfulCreate

Created pod: e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

openshift-ingress

multus

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-82ccfd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-82ccfd-85fb77bcf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-82ccfd: serviceaccount "payload-processing-e2e-inf-a-82ccfd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

AddedInterface

Add eth0 [10.133.0.246/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-82ccfd: serviceaccount "payload-processing-e2e-inf-a-82ccfd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-82ccfd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46

openshift-ingress

kubelet

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

Created

Container created
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled down replica set payload-processing-external-model-5fbb64fb6b from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5fbb64fb6b

SuccessfulDelete

Deleted pod: payload-processing-external-model-5fbb64fb6b-mgvv7

models-as-a-service

kubelet

payload-processing-external-model-5fbb64fb6b-mgvv7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

Unhealthy

Startup probe failed: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

ProbeError

Startup probe error: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdd208-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdd208-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdd208-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdd208-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-b-a479df-openshift-default-66bdb8fd8c

SuccessfulCreate

Created pod: e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

openshift-ingress

deployment-controller

e2e-inf-b-a479df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a479df-openshift-default-66bdb8fd8c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a479df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a479df

openshift-ingress

multus

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

Created

Container created

openshift-ingress

multus

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

AddedInterface

Add eth0 [10.133.0.251/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-82ccfd-openshift-default-854d9c95f

SuccessfulCreate

Created pod: e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-a-82ccfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-82ccfd-openshift-default-854d9c95f from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-82ccfd-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-a-82ccfd-openshift-default-854d9c95f

SuccessfulCreate

Created pod: e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

openshift-ingress

multus

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

AddedInterface

Add eth0 [10.133.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-a-82ccfd-openshift-default-854d9c95f

SuccessfulCreate

Created pod: e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz
(x2)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a479df-6869c8cd76

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a479df-6869c8cd76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a479df: serviceaccount "payload-processing-e2e-inf-b-a479df" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a479df-64564c5b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a479df-64564c5b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a479df: serviceaccount "payload-processing-e2e-inf-b-a479df" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a479df-64564c5b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l
(x2)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a479df-6869c8cd76

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s
(x2)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a479df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a479df-6869c8cd76 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a479df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a479df-64564c5b95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l

AddedInterface

Add eth0 [10.134.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

ProbeError

Startup probe error: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

Unhealthy

Startup probe failed: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

ProbeError

Startup probe error: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

Unhealthy

Startup probe failed: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

Unhealthy

Startup probe failed: Get "http://10.133.0.252:15021/healthz/ready": dial tcp 10.133.0.252:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

ProbeError

Startup probe error: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

Unhealthy

Startup probe failed: Get "http://10.132.1.12:15021/healthz/ready": dial tcp 10.132.1.12:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

ProbeError

Startup probe error: Get "http://10.132.1.12:15021/healthz/ready": dial tcp 10.132.1.12:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-56dc545b7c-d92fs

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-82ccfd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-82ccfd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-bdd208-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-inf-b-bdd208-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bdd208-openshift-default-8f948c485 from 1 to 2

openshift-ingress

multus

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

AddedInterface

Add eth0 [10.133.0.254/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-bdd208-openshift-default-8f948c485

SuccessfulCreate

Created pod: e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d66d22-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-d66d22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d66d22-openshift-default-64984c7669 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-d66d22-openshift-default-64984c7669

SuccessfulCreate

Created pod: e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

Started

Container started

openshift-ingress

multus

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

AddedInterface

Add eth0 [10.134.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

ProbeError

Startup probe error: Get "http://10.133.0.254:15021/healthz/ready": dial tcp 10.133.0.254:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

Unhealthy

Startup probe failed: Get "http://10.133.0.254:15021/healthz/ready": dial tcp 10.133.0.254:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

Unhealthy

Startup probe failed: Get "http://10.134.0.228:15021/healthz/ready": dial tcp 10.134.0.228:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

ProbeError

Startup probe error: Get "http://10.134.0.228:15021/healthz/ready": dial tcp 10.134.0.228:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-82ccfd-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-inf-a-82ccfd-openshift-default-854d9c95f

SuccessfulCreate

Created pod: e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

openshift-ingress

multus

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

AddedInterface

Add eth0 [10.132.1.16/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-82ccfd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-82ccfd-openshift-default-854d9c95f from 4 to 5

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

Unhealthy

Startup probe failed: Get "http://10.132.1.16:15021/healthz/ready": dial tcp 10.132.1.16:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

ProbeError

Startup probe error: Get "http://10.132.1.16:15021/healthz/ready": dial tcp 10.132.1.16:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

ProbeError

Readiness probe error: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-z896s

Unhealthy

Readiness probe failed: Get "http://10.132.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-a-w3-304459-openshift-default-6885974d55

SuccessfulDelete

Deleted pod: e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-304459-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

ProbeError

Readiness probe error: Get "http://10.132.0.253:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

Unhealthy

Readiness probe failed: Get "http://10.132.0.253:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-a-w3-304459-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w3-304459-openshift-default-6885974d55 from 4 to 3

openshift-ingress

kubelet

e2e-extmod-a-881f83-openshift-default-7f7b84cbd9-6r85h

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c5447d-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-881f83-c579c5979-vj4zx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-worker-w1-c5447d-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c5447d-openshift-default-5bf65d8949 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-c5447d-openshift-default-5bf65d8949

SuccessfulDelete

Deleted pod: e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-w22tm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-881f83-6b6777d984-fh7q9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-58rfd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d60c68-865c467cd-zgnz8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d60c68-768c8ccddc-lwqlw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-035d7d-7d5b89f7b-xqn8n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-035d7d-7dbd466b55-hpvrj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-88cbc7-6f6b9d7d94-pgzjx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-88cbc7-6549889655-glf7t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a479df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a479df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-035d7d-openshift-default-8957ffc65-vd6wv

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

ProbeError

Startup probe error: Get "http://10.132.1.15:15021/healthz/ready": dial tcp 10.132.1.15:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

Unhealthy

Startup probe failed: Get "http://10.132.1.15:15021/healthz/ready": dial tcp 10.132.1.15:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-d60c68-openshift-default-69c4849ff7-8fk6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-88cbc7-openshift-default-74778845d9-6lctm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-fc7ee7-6b565b88bd-c4tht

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-fc7ee7-5dd775bb8c-7fcnp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-3d9b36-5cf56c76bd-c976p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-3d9b36-5bcbf74867-k9hvd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d66d22-7bccc4d786-z6qjp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a479df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d66d22-54ddd954bc-5vz6p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-a479df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-fc7ee7-openshift-default-697d474cb7-ks4qn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-3d9b36-openshift-default-7d4d98b88f-rv565

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-kxntw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-d66d22-openshift-default-64984c7669-rjq28

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-304459-d7b764864-zwtww

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-304459-69f5bf967f-l4kvg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-aa2fdf-66dc96d4c6-8vn87

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-aa2fdf-65fc775d87-2n8sq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb1a2a-766d5fd4f8-tntkh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb1a2a-6857496555-hzg9s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-gbqqr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-fb1a2a-openshift-default-6bf8c78cbf-r6cgr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-5wb68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-aa2fdf-openshift-default-7585c7b855-cbr67

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-zn2gx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-6v5bh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-304459-openshift-default-6885974d55-znr6z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c5447d-b8dd68d55-n6rd6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c5447d-7bb465d9f8-89mpq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0dc148-7b74d7b55-zzv9d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0dc148-75b8cc658b-r89q5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-0dc148-openshift-default-5868c4797-sqsxb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a213d-65fd87589f-rr7jz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a213d-689cb5bf76-9b72m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e3d2ff-7ffc858867-5wpzf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e3d2ff-cbb67b84b-j59gb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7a213d-openshift-default-b7b455459-946hc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-176b6c-6bf94b8cd6-sq67c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-176b6c-755fcbcb8c-9695p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-2f6ee2-openshift-default-5c8958659f-xnjrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-dzpl9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-c5447d-openshift-default-5bf65d8949-zglzz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-2f6ee2-844666dcbd-56ppf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-2f6ee2-684d557c9-gf6cq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bdd208-784594d77d-z6qzr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.243:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-j7rjw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e3d2ff-openshift-default-77d9c5757-ln7sm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-wx6pz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-fbvmb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-176b6c-openshift-default-6dc4f8f6bf-m8lhq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-bdd208-openshift-default-8f948c485-cnr9b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bdd208-6dff5fbd47-69qxt

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.244:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9z6xd

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

Unhealthy

Readiness probe failed: Get "http://10.132.0.237:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-9z6xd

openshift-ingress

kubelet

e2e-extmod-a-ae795b-openshift-default-5b55749f85-xj7th

ProbeError

Readiness probe error: Get "http://10.132.0.237:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae795b-7b56f85c86-h8qt4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae795b-c4c647b59-btl9d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47

SuccessfulDelete

Deleted pod: e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

openshift-ingress

deployment-controller

e2e-worker-w4-3a61e1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-3a61e1-openshift-default-76c56d5b47 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-3a61e1-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-ks2zf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-0f6f96-openshift-default-79d9885d49-h8fxk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f6f96-56498d58d-j2kdc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f6f96-5d59889f9f-c8xpd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-82ccfd-85fb77bcf6-k8v46

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-19c94a-openshift-default-7fcfb9f54f-qkqrt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-19c94a-69db9c4498-s4qsp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-19c94a-87d4f8f55-kt6zq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6626v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-6vwsq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-z8fkg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-xhsvz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-82ccfd-openshift-default-854d9c95f-hhffg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-82ccfd-6b4c8757ff-rc85k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-knmrm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-knmrm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-tjlgk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-lpk2w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-tjlgk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-lpk2w

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 10 to 7

openshift-ingress

kubelet

e2e-shared-b-w4-7c88ae-openshift-default-5b4fb76df7-nbjcj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-7c88ae-b5798c666-c22gq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-7c88ae-55cccd4c87-s24xt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-a479df-openshift-default-66bdb8fd8c-qnd7q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a479df-64564c5b95-h7t4l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a479df-6869c8cd76-nd98s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-hxpzc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 7 to 6

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a525bd-5ff45ff7fd-vmtbh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-3a61e1-689c7f9675-6b84c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-3a61e1-6489f9fdfb-lt57n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a525bd-76c6469fff-stjks

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.153:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-54cxt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-2f69c8-openshift-default-566dd846b9

SuccessfulDelete

Deleted pod: e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-2f69c8-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-3a61e1-openshift-default-76c56d5b47-jtxk9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-2f69c8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-2f69c8-openshift-default-566dd846b9 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-a525bd-openshift-default-68dcf45b7c-d9m24

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5jnbd

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-f58f32-openshift-default-bd8b77d5c-c2bpz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f58f32-6d98748cbc-gj5qg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-8ebd65-84fd6bbf6d-6t7tb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f58f32-664f5dc478-zb7dn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-8ebd65-7cb68f4d79-z5vx4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-8ebd65-openshift-default-6469db79bc-7kwcw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-388653-56dfb7cb47-8th58

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-388653-576db78cbd-t8ncz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w0-388653-openshift-default-6cd774c57f-bjztw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2f69c8-66755b489d-m8vfx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2f69c8-5c5b8df9dc-xfxrd

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-b8mzp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-2f69c8-openshift-default-566dd846b9-5b7d6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-97vfn

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-97vfn

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-77f556d647-k5n95

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-77f556d647

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-77f556d647-k5n95
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x3)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-77f556d647 from 5 to 4