Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

test-curl-7652-85f34d

Scheduled

Successfully assigned opendatahub/test-curl-7652-85f34d to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

test-curl-7652-ad1e97

Scheduled

Successfully assigned opendatahub/test-curl-7652-ad1e97 to ip-10-0-141-82.us-west-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-tf9kq

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-tf9kq to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2 to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

test-curl-7652-bc4f22

Scheduled

Successfully assigned opendatahub/test-curl-7652-bc4f22 to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

odh-model-controller-769875db56-qx8nl

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-qx8nl to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

test-curl-7658-11fc4d

Scheduled

Successfully assigned opendatahub/test-curl-7658-11fc4d to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

test-curl-7658-8e7216

Scheduled

Successfully assigned opendatahub/test-curl-7658-8e7216 to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

test-curl-7658-9bc8f7

Scheduled

Successfully assigned opendatahub/test-curl-7658-9bc8f7 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-bmxth

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-bmxth to ip-10-0-141-82.us-west-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-zkp79

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-zkp79 to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

test-curl-7658-9d8cc3

Scheduled

Successfully assigned opendatahub/test-curl-7658-9d8cc3 to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

test-curl-7664-33eafa

Scheduled

Successfully assigned opendatahub/test-curl-7664-33eafa to ip-10-0-133-5.us-west-2.compute.internal

opendatahub

test-curl-7664-453970

Scheduled

Successfully assigned opendatahub/test-curl-7664-453970 to ip-10-0-133-5.us-west-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-929tg

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-929tg to ip-10-0-141-82.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-84bc87c977-6fxdh to ip-10-0-141-82.us-west-2.compute.internal

opendatahub

maas-controller-84769bb5bf-j5wbn

Scheduled

Successfully assigned opendatahub/maas-controller-84769bb5bf-j5wbn to ip-10-0-139-46.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-84bc87c977-7dw9z to ip-10-0-139-46.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-84bc87c977-wpl58

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-84bc87c977-wpl58 to ip-10-0-133-5.us-west-2.compute.internal

opendatahub

maas-controller-549656c76d-4cnkj

Scheduled

Successfully assigned opendatahub/maas-controller-549656c76d-4cnkj to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-wlnm5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-wlnm5 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc to ip-10-0-133-5.us-west-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-cp797

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-cp797 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-lpfj5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-lpfj5 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg to ip-10-0-139-46.us-west-2.compute.internal

kuadrant-system

authorino-57f7f8659f-969ld

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-969ld to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-ksw98

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-ksw98 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-ksglt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-ksglt to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-jbljg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-jbljg to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-mrq5j to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-xtzhq

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-xtzhq to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw to ip-10-0-141-82.us-west-2.compute.internal

kuadrant-system

authorino-64d8b4548c-bhhfv

Scheduled

Successfully assigned kuadrant-system/authorino-64d8b4548c-bhhfv to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-72zzh to ip-10-0-133-5.us-west-2.compute.internal

kuadrant-system

authorino-6754bbb7d6-nf8jh

Scheduled

Successfully assigned kuadrant-system/authorino-6754bbb7d6-nf8jh to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-pwbsh to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a3aa65-openshift-default-57649d9c-657f7 to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-sdnsl

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-sdnsl to ip-10-0-141-82.us-west-2.compute.internal

kuadrant-system

authorino-6d6676b56-w5w5l

Scheduled

Successfully assigned kuadrant-system/authorino-6d6676b56-w5w5l to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-138566-869577984b-lbbd7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-138566-869577984b-lbbd7 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-98zzv to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-c8mgv to ip-10-0-141-82.us-west-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-ljvv5

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-ljvv5 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-575956cc9c6mmf7

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-575956cc9c6mmf7 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-hkg2v to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-btfp8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-btfp8 to ip-10-0-139-46.us-west-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-vqwsv

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-vqwsv to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-ccz7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-ccz7d to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-vjrqn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-vjrqn to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-s4ndm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-s4ndm to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856 to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-qzpg5

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-qzpg5 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-api-b-97f097-openshift-default-589b54574c-469zm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-97f097-openshift-default-589b54574c-469zm to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-bpm9h to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-85wfj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-85wfj to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-6ljr6 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh to ip-10-0-133-5.us-west-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-p8zgz

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-p8zgz to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv to ip-10-0-133-5.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-f854549f8-rptzn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-f854549f8-rptzn to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-bzpq4

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-bzpq4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-wngtx

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-wngtx to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs to ip-10-0-141-82.us-west-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-xfkcg

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-xfkcg to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-4kb4v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-4kb4v to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-7df854bf67-2cvb2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-7df854bf67-2cvb2 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc to ip-10-0-139-46.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-r5c8j

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-r5c8j to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-695f5c-openshift-default-94db46fbf-9c272 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-794f59cf45-pbxxx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-794f59cf45-pbxxx to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj to ip-10-0-141-82.us-west-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-zzt2k

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-zzt2k to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-794f59cf45-94n4w

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-794f59cf45-94n4w to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lf2mr to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8 to ip-10-0-133-5.us-west-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-w2slh

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-w2slh to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-l8t6z to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-6bddq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6bddq to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-695f5c-7698569c67-425hl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-695f5c-7698569c67-425hl to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7 to ip-10-0-139-46.us-west-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-pfgpx

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-pfgpx to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-p5nl5

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-p5nl5 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-668d64f647-59zws

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-668d64f647-59zws to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x to ip-10-0-139-46.us-west-2.compute.internal

opendatahub

ai-gateway-controller-75b78c64d-gqk9g

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-75b78c64d-gqk9g to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-nf5gh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-nf5gh to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-52f191-fdd756487-t6lgk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-52f191-fdd756487-t6lgk to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g to ip-10-0-139-46.us-west-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-16c49820-84664c54c-2592k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-16c49820-84664c54c-2592k to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx to ip-10-0-133-5.us-west-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-6b74q

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-6b74q to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn to ip-10-0-141-82.us-west-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-phngz

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-phngz to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6 to ip-10-0-141-82.us-west-2.compute.internal

llm

e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn

Scheduled

Successfully assigned llm/e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-5a5534-7ffd856679-24hkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5a5534-7ffd856679-24hkw to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f to ip-10-0-133-5.us-west-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-zsvqf

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-zsvqf to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc to ip-10-0-141-82.us-west-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

router-default-57f669cfc9-d755h

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-57f669cfc9-d755h

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-57f669cfc9-d755h

Scheduled

Successfully assigned openshift-ingress/router-default-57f669cfc9-d755h to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-355213-openshift-default-6f7c585497-dpv7l to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp to ip-10-0-141-82.us-west-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-79krz

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-79krz to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-explicit-355213-openshift-default-6f7c585497-62cld

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-355213-openshift-default-6f7c585497-62cld to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-j6sfz to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-lg8h5 to ip-10-0-141-82.us-west-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-564c6

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-564c6 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r to ip-10-0-141-82.us-west-2.compute.internal

cert-manager

cert-manager-597b95cb84-qwk6v

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-qwk6v to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft to ip-10-0-141-82.us-west-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-75c548b644-v2wl2

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-75c548b644-v2wl2 to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-lgjkp to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-pnsfb to ip-10-0-133-5.us-west-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4 to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-6jftz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-6jftz to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf to ip-10-0-141-82.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-866b9fd699-kvmpl

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-866b9fd699-kvmpl to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-vmqvj to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-wcxns to ip-10-0-139-46.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-64f8c8bfbd-l9dfg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-64f8c8bfbd-l9dfg to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4c260505-openshift-default-6f77466685-xdbqw to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4 to ip-10-0-133-5.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-78677bf7-fm4j7

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-78677bf7-fm4j7 to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv to ip-10-0-141-82.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-noten-970415-openshift-default-658c8594d5-rddlq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-970415-openshift-default-658c8594d5-rddlq to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2 to ip-10-0-141-82.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-866b9fd699-2z7wc

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-866b9fd699-2z7wc to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj to ip-10-0-133-5.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs to ip-10-0-139-46.us-west-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-57f669cfc9 from 0 to 1

openshift-ingress

replicaset-controller

router-default-57f669cfc9

SuccessfulCreate

Created pod: router-default-57f669cfc9-d755h

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x3)

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

Created

Container created

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

Started

Container started

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-57f669cfc9-d755h

AddedInterface

Add eth0 [10.133.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 500

openshift-ingress

kubelet

router-default-57f669cfc9-d755h

ProbeError

Startup probe error: HTTP probe failed with statuscode: 500 body: [-]backend-proxy-http failed: reason withheld [-]has-synced failed: reason withheld [+]process-running ok healthz check failed

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nf5gh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-nf5gh

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-nf5gh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nf5gh

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nf5gh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.962s (3.962s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nf5gh

Started

Container started
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nf5gh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nf5gh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7df854bf67 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-hkg2v

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-668d64f647

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-668d64f647-59zws

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-668d64f647 from 0 to 1

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-668d64f647-59zws

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-hkg2v

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-668d64f647-59zws

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-668d64f647-59zws

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-668d64f647-59zws

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.937s (12.937s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-668d64f647-59zws

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 14.242s (14.242s including waiting). Image size: 183555333 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-wngtx

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-wngtx

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-wngtx

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1
(x7)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-zkp79

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-wngtx

Started

Container started

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-zkp79

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-zkp79

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-wngtx

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.761s (3.761s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-wngtx

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-wngtx_fc64cfdf-b996-45e0-b7d9-ee5fb6bc53d2 became leader

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-tf9kq

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-tf9kq

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf9kq

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-zkp79

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.397s (4.397s including waiting). Image size: 309650901 bytes.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-zkp79

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-zkp79

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf9kq

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.474s (3.474s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf9kq

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-tf9kq

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-vqwsv

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

multus

authorino-operator-7b7bb4bc77-vqwsv

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-vqwsv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

cert-manager

kubelet

cert-manager-597b95cb84-qwk6v

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-qwk6v

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-qwk6v

cert-manager

kubelet

cert-manager-597b95cb84-qwk6v

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-qwk6v

Started

Container started

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-pfgpx

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-pfgpx

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-vqwsv

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-vqwsv

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-vqwsv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.646s (3.646s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pfgpx

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

authorino-operator-7b7bb4bc77-vqwsv_bc36c3e1-cb87-4b57-8ac4-9d3b98f63f4f

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-vqwsv_bc36c3e1-cb87-4b57-8ac4-9d3b98f63f4f became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pfgpx

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pfgpx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.724s (2.724s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-pfgpx

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-p8zgz

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

limitador-operator-controller-manager-5778bb4449-pfgpx_6c6855be-9f21-46d9-8e03-b864a2172ac1

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-pfgpx_6c6855be-9f21-46d9-8e03-b864a2172ac1 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-p8zgz

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-84bc87c977 from 0 to 3

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-p8zgz

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-84bc87c977

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-84bc87c977-7dw9z

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-84bc87c977

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-84bc87c977-6fxdh

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-84bc87c977

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-84bc87c977-wpl58

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-84bc87c977-6fxdh

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-84bc87c977-7dw9z

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-84bc87c977-wpl58

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-p8zgz

Created

Container created

kuadrant-system

dns-operator-controller-manager-8557cbdb84-p8zgz_088d95eb-e29d-4826-8bfd-5763d4321cb0

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-p8zgz_088d95eb-e29d-4826-8bfd-5763d4321cb0 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-p8zgz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.026s (3.026s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-p8zgz

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.634s (3.634s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.425s (3.425s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.578s (3.578s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 952ms (952ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-7dw9z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 861ms (861ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Started

Container started

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-r5c8j

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 840ms (840ms including waiting). Image size: 273709574 bytes.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-r5c8j

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-wpl58

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-84bc87c977-6fxdh

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

opendatahub-operator-controller-manager-84bc87c977-7dw9z_c87f0dd1-8f84-4923-af2e-66e0e418d22c

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-84bc87c977-7dw9z_c87f0dd1-8f84-4923-af2e-66e0e418d22c became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-r5c8j

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-r5c8j

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.465s (5.465s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-r5c8j

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-r5c8j

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-r5c8j_b6eef079-6274-4e5f-b8e6-e909917fd153

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-r5c8j_b6eef079-6274-4e5f-b8e6-e909917fd153 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-xfkcg

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xfkcg

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-xfkcg

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xfkcg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 7.161s (7.161s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xfkcg

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-xfkcg

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-hfdqf"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-lpx8d"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-ingress

replicaset-controller

kube-auth-proxy-794f59cf45

SuccessfulCreate

Created pod: kube-auth-proxy-794f59cf45-94n4w

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-794f59cf45

SuccessfulCreate

Created pod: kube-auth-proxy-794f59cf45-pbxxx

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-794f59cf45 from 0 to 2

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-94n4w

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-794f59cf45-94n4w

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-pbxxx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-575956cc9c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-575956cc9c6mmf7

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-794f59cf45-pbxxx

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-575956cc9c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-575956cc9c6mmf7

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-575956cc9c6mmf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-zzt2k

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-575956cc9c6mmf7

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-575956cc9c6mmf7

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-75c548b644

SuccessfulCreate

Created pod: jobset-controller-manager-75c548b644-v2wl2

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-75c548b644 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-zzt2k

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-zzt2k

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-pbxxx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.621s (3.621s including waiting). Image size: 188904677 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-75c548b644-v2wl2

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-75c548b644-v2wl2

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-969ld

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-94n4w

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-94n4w

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-94n4w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.018s (3.018s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

authorino-57f7f8659f-969ld

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-pbxxx

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-794f59cf45-pbxxx

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-969ld

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-w2slh

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-cp797

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp797

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-56c6c9ddd5-cp797

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-zzt2k

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 4.041s (4.041s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-zzt2k

Started

Container started

kuadrant-system

multus

limitador-limitador-7c9b87d574-w2slh

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-w2slh

Pulled

Container image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-w2slh

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-zzt2k

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-w2slh

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-969ld

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-75c548b644-v2wl2

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-75c548b644-v2wl2

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-75c548b644-v2wl2

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.34s (4.34s including waiting). Image size: 182184678 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-969ld

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-969ld

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.095s (3.096s including waiting). Image size: 204096810 bytes.

openshift-jobset-operator

jobset-controller-manager-75c548b644-v2wl2_584cc169-aef8-45f3-a3fd-d0088b3d00c2

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-75c548b644-v2wl2_584cc169-aef8-45f3-a3fd-d0088b3d00c2 became leader

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-969ld

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp797

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.632s (2.632s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp797

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp797

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-969ld

Killing

Stopping container authorino

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-qzpg5

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-qzpg5

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qzpg5

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qzpg5

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qzpg5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 3.017s (3.017s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-qzpg5

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-zzt2k

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-zzt2k

Killing

Stopping container limitador
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kserve-module-controller-manager-7566cf5fc8-qzpg5_d7e89711-7479-43d0-bbbb-b2415c2df40e

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-qzpg5_d7e89711-7479-43d0-bbbb-b2415c2df40e became leader

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-84769bb5bf from 0 to 1

opendatahub

replicaset-controller

maas-controller-549656c76d

SuccessfulCreate

Created pod: maas-controller-549656c76d-4cnkj

opendatahub

replicaset-controller

maas-controller-84769bb5bf

SuccessfulCreate

Created pod: maas-controller-84769bb5bf-j5wbn

opendatahub

kubelet

maas-controller-549656c76d-4cnkj

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:58c585b89c29e2a15853c6577edb8c636344e66ee1bbeb9ef7d4cb60ee38b1a3"

opendatahub

multus

maas-controller-549656c76d-4cnkj

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-549656c76d from 0 to 1

opendatahub

multus

maas-controller-84769bb5bf-j5wbn

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-84769bb5bf-j5wbn

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:58c585b89c29e2a15853c6577edb8c636344e66ee1bbeb9ef7d4cb60ee38b1a3"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-l8t6z

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-549656c76d-4cnkj

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:58c585b89c29e2a15853c6577edb8c636344e66ee1bbeb9ef7d4cb60ee38b1a3" in 7.903s (7.903s including waiting). Image size: 200069643 bytes.

opendatahub

kubelet

maas-controller-549656c76d-4cnkj

Started

Container started

opendatahub

kubelet

maas-controller-84769bb5bf-j5wbn

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:58c585b89c29e2a15853c6577edb8c636344e66ee1bbeb9ef7d4cb60ee38b1a3" in 7.143s (7.143s including waiting). Image size: 200069643 bytes.

opendatahub

kubelet

maas-controller-84769bb5bf-j5wbn

Created

Container created

opendatahub

kubelet

maas-controller-84769bb5bf-j5wbn

Started

Container started

opendatahub

kubelet

maas-controller-549656c76d-4cnkj

Created

Container created

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-bmxth

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

Started

Container started

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-bzpq4

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

Created

Container created

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-xtzhq

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.072s (4.072s including waiting). Image size: 185476477 bytes.

opendatahub

maas-controller-84769bb5bf-j5wbn_ff2531d2-3ff7-48c4-8e7d-906aee69e41e

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-84769bb5bf-j5wbn_ff2531d2-3ff7-48c4-8e7d-906aee69e41e became leader

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-qx8nl

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-xtzhq

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

opendatahub

multus

model-serving-api-75bd89fdfc-bmxth

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

multus

kserve-controller-manager-776cc66d47-bzpq4

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-bzpq4

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtzhq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-bmxth

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

odh-model-controller-769875db56-qx8nl

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

odh-model-controller-769875db56-qx8nl

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-l8t6z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-929tg

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nf5gh

Killing

Stopping container discovery

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-929tg

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-nf5gh

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-929tg

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-bmxth

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.317s (3.317s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtzhq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 3.693s (3.693s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-929tg

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtzhq

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtzhq

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-bmxth

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-bzpq4

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.632s (3.632s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-bzpq4

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-bmxth

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-bzpq4

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-qx8nl

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-qx8nl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 4.152s (4.152s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-qx8nl

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-bzpq4_2252da6c-e8c4-47e7-8859-1030ef857843

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-bzpq4_2252da6c-e8c4-47e7-8859-1030ef857843 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-xtzhq_ae3ee72f-4f56-4b67-b739-28ae7f0b2f5d

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-xtzhq_ae3ee72f-4f56-4b67-b739-28ae7f0b2f5d became leader

opendatahub

odh-model-controller-769875db56-qx8nl_6cc72cf0-397f-4f8e-ba2c-cd2367f87499

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-qx8nl_6cc72cf0-397f-4f8e-ba2c-cd2367f87499 became leader

opendatahub

replicaset-controller

maas-controller-549656c76d

SuccessfulDelete

Deleted pod: maas-controller-549656c76d-4cnkj

opendatahub

kubelet

maas-controller-549656c76d-4cnkj

Killing

Stopping container manager

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-549656c76d from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-929tg

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-929tg

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 12.912s (12.912s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-929tg

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-ljvv5

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6754bbb7d6 from 0 to 1

kuadrant-system

multus

authorino-6754bbb7d6-nf8jh

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6754bbb7d6-nf8jh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6754bbb7d6

SuccessfulCreate

Created pod: authorino-6754bbb7d6-nf8jh

kuadrant-system

replicaset-controller

authorino-6754bbb7d6

SuccessfulDelete

Deleted pod: authorino-6754bbb7d6-nf8jh

kuadrant-system

replicaset-controller

authorino-6d6676b56

SuccessfulCreate

Created pod: authorino-6d6676b56-w5w5l

kuadrant-system

multus

authorino-6f6944bcdd-ljvv5

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f6944bcdd-ljvv5

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-ljvv5

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6754bbb7d6 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6d6676b56 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-6d6676b56-w5w5l

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6d6676b56-w5w5l

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-ljvv5

Started

Container started

kuadrant-system

kubelet

authorino-6d6676b56-w5w5l

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.499s (1.499s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-ljvv5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.592s (1.592s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6754bbb7d6-nf8jh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.481s (1.481s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6754bbb7d6-nf8jh

Created

Container created

kuadrant-system

kubelet

authorino-6754bbb7d6-nf8jh

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-ljvv5

Created

Container created

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-cp797

kuadrant-system

kubelet

authorino-6f6944bcdd-ljvv5

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-6754bbb7d6-nf8jh

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6d6676b56-w5w5l

Created

Container created

kuadrant-system

kubelet

authorino-6d6676b56-w5w5l

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-cp797

Killing

Stopping container authorino
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-sdnsl

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-sdnsl

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-sdnsl

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-sdnsl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 835ms (835ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-sdnsl

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-sdnsl

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-xtzhq

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-xtzhq

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-p5nl5

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p5nl5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-p5nl5

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p5nl5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.043s (2.043s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p5nl5

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p5nl5

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-p5nl5_07168d92-d606-49d5-9608-e7945dd01bef

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-p5nl5_07168d92-d606-49d5-9608-e7945dd01bef became leader
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-ccz7d
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-6jftz

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

multus

payload-pre-processing-7b98bb678c-6jftz

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6jftz

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-ccz7d

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-ccz7d

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6jftz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6jftz

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-ccz7d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6jftz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.84s (2.84s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-ccz7d

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-ccz7d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.801s (2.801s including waiting). Image size: 125353965 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-75b78c64d from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-75b78c64d

SuccessfulCreate

Created pod: ai-gateway-controller-75b78c64d-gqk9g

opendatahub

kubelet

ai-gateway-controller-75b78c64d-gqk9g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-75b78c64d-gqk9g

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-75b78c64d-gqk9g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 831ms (831ms including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-75b78c64d-gqk9g

Created

Container created

opendatahub

kubelet

ai-gateway-controller-75b78c64d-gqk9g

Started

Container started

opendatahub

llmisvc-controller-manager-6466c554d8-sdnsl_305ad186-85e3-43fa-bd80-3ead8ce1a95b

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-sdnsl_305ad186-85e3-43fa-bd80-3ead8ce1a95b became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-p5nl5

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-p5nl5

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.908s (1.908s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-6xqm9

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-6b74q

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6b74q

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-6b74q

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6b74q

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 576ms (576ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6b74q

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-6b74q

Started

Container started

opendatahub

ai-gateway-controller-75b78c64d-gqk9g_6c06195c-1a33-423c-aae9-9de4af5bce9b

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-75b78c64d-gqk9g_6c06195c-1a33-423c-aae9-9de4af5bce9b became leader

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-phngz

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-phngz

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-phngz

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-phngz

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 543ms (543ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-phngz

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-phngz

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.DestinationRule llm/e2e-external-token-limit-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-external-token-limit-simulated-kserve-65fc98cd9c

SuccessfulCreate

Created pod: e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn

llm

deployment-controller

e2e-external-token-limit-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-external-token-limit-simulated-kserve-65fc98cd9c from 0 to 1

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.Secret llm/e2e-external-token-limit-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.Deployment llm/e2e-external-token-limit-simulated-kserve

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.Service llm/e2e-external-token-limit-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.HTTPRoute llm/e2e-external-token-limit-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.PodMonitor llm/e2e-external-token-limit-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.NetworkPolicy llm/e2e-external-token-limit-simulated-prometheus-scraping

llm

multus

e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 561ms (561ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn

Created

Container created

llm

kubelet

e2e-external-token-limit-simulated-kserve-65fc98cd9c-t7gcn

Started

Container started

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Created

Created v1.PodMonitor llm/e24c8173cd67cca19f868a6ecff2b3963-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-zsvqf

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zsvqf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-zsvqf

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zsvqf

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zsvqf

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-zsvqf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 592ms (592ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 559ms (559ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8d8gtr

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-79krz

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

kubelet

echo-simulator-kserve-64b6f8f96c-79krz

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-79krz

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-564c6

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-564c6

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-79krz

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-79krz

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-564c6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

echo-simulator-kserve-64b6f8f96c-79krz

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.737s (2.737s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-564c6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 600ms (600ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-564c6

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-564c6

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 574ms (574ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

Updated

Updated v1.Secret llm/e2e-external-token-limit-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-external-token-limit-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-external-token-limit-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7df854bf67 from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-vjrqn

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-ksw98

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-pwbsh

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-vjrqn

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-ksw98

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-pwbsh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-vjrqn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-vjrqn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-vjrqn

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.999s (3.999s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.032s (4.032s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Started

Container started

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-vjrqn

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-vjrqn

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-64d8b4548c

SuccessfulCreate

Created pod: authorino-64d8b4548c-bhhfv

kuadrant-system

kubelet

authorino-64d8b4548c-bhhfv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-64d8b4548c-bhhfv

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-64d8b4548c-bhhfv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.235s (2.235s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-64d8b4548c-bhhfv

Started

Container started

kuadrant-system

kubelet

authorino-64d8b4548c-bhhfv

Created

Container created

kuadrant-system

kubelet

authorino-6d6676b56-w5w5l

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-6d6676b56

SuccessfulDelete

Deleted pod: authorino-6d6676b56-w5w5l
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-6d6676b56 from 1 to 0

openshift-ingress

gateway_labeler_controller

e2e-ait-a1d107b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a1d107b0

openshift-ingress

gateway_labeler_controller

e2e-ait-ebf644d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ebf644d4

openshift-ingress

deployment-controller

e2e-ait-a1d107b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a1d107b0-openshift-default-5646bbf8d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a1d107b0-openshift-default-5646bbf8d5

SuccessfulCreate

Created pod: e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

openshift-ingress

gateway_labeler_controller

e2e-migrate-16c49820-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-16c49820-gw

openshift-ingress

deployment-controller

e2e-ait-ebf644d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ebf644d4-openshift-default-f64795575 from 0 to 1

openshift-ingress

multus

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-ebf644d4-openshift-default-f64795575

SuccessfulCreate

Created pod: e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

openshift-ingress

replicaset-controller

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57

SuccessfulCreate

Created pod: e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

openshift-ingress

deployment-controller

e2e-migrate-16c49820-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57 from 0 to 1

openshift-ingress

multus

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-09d8fb9b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-09d8fb9b

openshift-ingress

replicaset-controller

e2e-ait-09d8fb9b-openshift-default-678f87597

SuccessfulCreate

Created pod: e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

openshift-ingress

deployment-controller

e2e-ait-09d8fb9b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-09d8fb9b-openshift-default-678f87597 from 0 to 1

openshift-ingress

multus

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a1d107b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a1d107b0-7848ff8d87 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a1d107b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a1d107b0: serviceaccount "payload-processing-e2e-ait-a1d107b0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a1d107b0-7848ff8d87

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a1d107b0-7848ff8d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a1d107b0: serviceaccount "payload-processing-e2e-ait-a1d107b0" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a1d107b0-7848ff8d87

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc

openshift-ingress

deployment-controller

e2e-derive-ffe7a1cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ffe7a1cf-openshift-default-69875798d5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-ffe7a1cf-openshift-default-69875798d5

SuccessfulCreate

Created pod: e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

openshift-ingress

gateway_labeler_controller

e2e-derive-ffe7a1cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ffe7a1cf

openshift-ingress

kubelet

payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv

Created

Container created

openshift-ingress

multus

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ebf644d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ebf644d4-66bffcbb8f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ebf644d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ebf644d4-66bffcbb8f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k

openshift-ingress

multus

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

openshift-ingress

multus

payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ebf644d4: serviceaccount "payload-processing-e2e-ait-ebf644d4" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ebf644d4-66bffcbb8f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ebf644d4-66bffcbb8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ebf644d4: serviceaccount "payload-processing-e2e-ait-ebf644d4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ait-09d8fb9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-09d8fb9b: serviceaccount "payload-processing-e2e-ait-09d8fb9b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-09d8fb9b: serviceaccount "payload-processing-e2e-ait-09d8fb9b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-09d8fb9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-09d8fb9b-54956d9467 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

openshift-ingress

kubelet

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 913ms (913ms including waiting). Image size: 125353965 bytes.

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-16c49820-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-16c49820

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-16c49820-84664c54c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-16c49820-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.283s (3.283s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 803ms (803ms including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-16c49820-5654f658d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-16c49820-5654f658d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-16c49820-5654f658d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-16c49820: serviceaccount "payload-processing-e2e-migrate-16c49820" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-16c49820

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-16c49820-5654f658d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-16c49820-84664c54c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-16c49820-84664c54c-2592k
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-16c49820-84664c54c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-16c49820-84664c54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-16c49820: serviceaccount "payload-processing-e2e-migrate-16c49820" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-16c49820-84664c54c-2592k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-16c49820-84664c54c-2592k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-16c49820-84664c54c-2592k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-16c49820-84664c54c-2592k

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ffe7a1cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ffe7a1cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ffe7a1cf-6976c8c597 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ffe7a1cf: serviceaccount "payload-processing-e2e-derive-ffe7a1cf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ffe7a1cf-6976c8c597

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ffe7a1cf-6976c8c597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ffe7a1cf: serviceaccount "payload-processing-e2e-derive-ffe7a1cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ffe7a1cf-6976c8c597

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj

openshift-ingress

kubelet

payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.631s (2.631s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-16c49820-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-16c49820-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ebf644d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ebf644d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ebf644d4-6b5d7b4747-7jqqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ait-ebf644d4-66bffcbb8f-lqh8k

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ebf644d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ebf644d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09d8fb9b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-09d8fb9b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-09d8fb9b-7bc65f5f7f-hl4mj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-09d8fb9b-54956d9467-lncnc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ffe7a1cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ffe7a1cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-ebf644d4-openshift-default-f64795575-8vdnf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-09d8fb9b-openshift-default-678f87597-59fmk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a1d107b0-56ffb8d479-5zgmc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a1d107b0-7848ff8d87-gdkvv

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-26743a-openshift-default-56b6f9f987

SuccessfulCreate

Created pod: e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-26743a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-26743a

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-26743a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-26743a-openshift-default-56b6f9f987 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-16c49820-84664c54c-2592k

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-9a5623

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-9a5623

openshift-ingress

multus

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-16c49820-5654f658d7-v744c

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ffe7a1cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-ffe7a1cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ffe7a1cf-5d5f9fd695-6qx4p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ffe7a1cf-6976c8c597-t5ncj

Killing

Stopping container payload-processing
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a1d107b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-a1d107b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-56f3fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-56f3fe

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-9a5623

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-9a5623-597c949cc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-9a5623-597c949cc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-9a5623: serviceaccount "payload-processing-e2e-worker-w0-9a5623" not found

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:33148->10.133.0.57:15021: read: connection reset by peer body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-9a5623

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-9a5623-597c949cc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-9a5623-597c949cc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-9a5623: serviceaccount "payload-processing-e2e-worker-w0-9a5623" not found

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:33148->10.133.0.57:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-a1d107b0-openshift-default-5646bbf8d5-xbqsw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x3)

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-16c49820-gw-openshift-default-9d8cdcf57-bvkjn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-ffe7a1cf-openshift-default-69875798d5-rcxgg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-26743a-fcb59c9c7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-26743a-fcb59c9c7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-26743a-fcb59c9c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-26743a: serviceaccount "payload-processing-e2e-worker-w4-26743a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-26743a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-26743a-fcb59c9c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-26743a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-26743a-75976bb55f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-26743a: serviceaccount "payload-processing-e2e-worker-w4-26743a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-56f3fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-56f3fe-78865dc69c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-56f3fe: serviceaccount "payload-processing-e2e-worker-w2-56f3fe" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-56f3fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-4d14e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-4d14e0
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-56f3fe-78865dc69c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-56f3fe-78865dc69c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-56f3fe: serviceaccount "payload-processing-e2e-worker-w2-56f3fe" not found

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-56f3fe-78865dc69c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-3c4802

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-3c4802

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 0 to 1

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4d14e0: serviceaccount "payload-processing-e2e-worker-w3-4d14e0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-4d14e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-4d14e0: serviceaccount "payload-processing-e2e-worker-w3-4d14e0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-4d14e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-3c4802

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-3c4802-5f6bddd989 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-3c4802-5f6bddd989

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-3c4802-5f6bddd989

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-3c4802-5f6bddd989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-3c4802: serviceaccount "payload-processing-e2e-worker-w1-3c4802" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-3c4802: serviceaccount "payload-processing-e2e-worker-w1-3c4802" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-3c4802

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-hkg2v

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-hkg2v

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

Started

Container started

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-f854549f8 from 0 to 1
(x7)

models-as-a-service

replicaset-controller

payload-processing-external-model-f854549f8

FailedCreate

Error creating: pods "payload-processing-external-model-f854549f8-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-f854549f8

SuccessfulCreate

Created pod: payload-processing-external-model-f854549f8-rptzn

models-as-a-service

multus

payload-processing-external-model-f854549f8-rptzn

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-f854549f8-rptzn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-f854549f8-rptzn

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-f854549f8-rptzn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-btfp8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7df854bf67 from 3 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-6ljr6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-s4ndm

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-6ljr6

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-s4ndm

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-btfp8

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-64f8c8bfbd from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-64f8c8bfbd

SuccessfulCreate

Created pod: payload-processing-external-model-64f8c8bfbd-l9dfg

models-as-a-service

kubelet

payload-processing-external-model-64f8c8bfbd-l9dfg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-64f8c8bfbd-l9dfg

Started

Container started

models-as-a-service

multus

payload-processing-external-model-64f8c8bfbd-l9dfg

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-64f8c8bfbd-l9dfg

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7df854bf67 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-bpm9h

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-lpfj5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-bpm9h

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-mrq5j

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-lpfj5

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-7df854bf67-mrq5j

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-4kb4v

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 2 to 3

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

Created

Container created

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x4)

models-as-a-service

kubelet

payload-processing-external-model-f854549f8-rptzn

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-7653478ffe43" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-64f8c8bfbd from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-64f8c8bfbd

SuccessfulDelete

Deleted pod: payload-processing-external-model-64f8c8bfbd-l9dfg

models-as-a-service

kubelet

payload-processing-external-model-64f8c8bfbd-l9dfg

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-866b9fd699

SuccessfulCreate

Created pod: payload-processing-external-model-866b9fd699-2z7wc
(x7)

models-as-a-service

kubelet

payload-processing-external-model-64f8c8bfbd-l9dfg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

multus

payload-processing-external-model-866b9fd699-2z7wc

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-2z7wc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-2z7wc

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-2z7wc

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x4)

models-as-a-service

kubelet

payload-processing-external-model-f854549f8-rptzn

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-fd60520bcb62" not found

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 1 to 2

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-78677bf7

SuccessfulCreate

Created pod: payload-processing-external-model-78677bf7-fm4j7
(x9)

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-2z7wc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-2z7wc

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-78677bf7 from 0 to 1

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-866b9fd699 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-866b9fd699

SuccessfulDelete

Deleted pod: payload-processing-external-model-866b9fd699-2z7wc

models-as-a-service

kubelet

payload-processing-external-model-78677bf7-fm4j7

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-78677bf7-fm4j7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-78677bf7-fm4j7

Started

Container started

models-as-a-service

multus

payload-processing-external-model-78677bf7-fm4j7

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-f854549f8 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-f854549f8-rptzn

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-f854549f8

SuccessfulDelete

Deleted pod: payload-processing-external-model-f854549f8-rptzn

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

Started

Container started

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Started

Container started

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

Created

Container created

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

Started

Container started

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-866b9fd699-kvmpl

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-866b9fd699 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-866b9fd699

SuccessfulCreate

Created pod: payload-processing-external-model-866b9fd699-kvmpl

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-kvmpl

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-kvmpl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-kvmpl

Started

Container started
(x2)

models-as-a-service

kubelet

payload-processing-external-model-78677bf7-fm4j7

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-00e4c0ba7157" not found, secret "agc-cred-3d0f8113fe57" not found]

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 4 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-kvmpl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-kvmpl

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-78677bf7-fm4j7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

Started

Container started

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 3 to 5

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs
(x3)

models-as-a-service

kubelet

payload-processing-external-model-78677bf7-fm4j7

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-00e4c0ba7157" not found, secret "agc-cred-3d0f8113fe57" not found, secret "agc-cred-7653478ffe43" not found]

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

Started

Container started
(x9)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-866b9fd699-kvmpl

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.97:50052" within 1s: context deadline exceeded
(x11)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Unhealthy

Liveness probe failed: Get "https://10.134.0.34:8000/health": context deadline exceeded
(x11)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x12)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x13)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x12)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

Unhealthy

Startup probe failed: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 8 to 9
(x2)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

Created

Container created
(x8)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

ProbeError

Startup probe error: Get "http://10.133.0.99:15021/healthz/ready": dial tcp 10.133.0.99:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

ProbeError

Startup probe error: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

Unhealthy

Startup probe failed: Get "http://10.133.0.101:15021/healthz/ready": dial tcp 10.133.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Unhealthy

Liveness probe failed: Get "https://10.134.0.34:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

openshift-ingress

deployment-controller

e2e-mt-4c260505-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4c260505-openshift-default-6f77466685 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-4c260505

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4c260505

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4c260505

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4c260505-65bb6f8647 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4c260505

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4c260505-68cf845c4f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4c260505-68cf845c4f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4c260505-68cf845c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4c260505: serviceaccount "payload-processing-e2e-mt-4c260505" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4c260505-68cf845c4f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4c260505-65bb6f8647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4c260505-65bb6f8647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4c260505: serviceaccount "payload-processing-e2e-mt-4c260505" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4c260505-65bb6f8647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 6 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

Started

Container started

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Started

Container started

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w4-26743a-openshift-default-56b6f9f987

SuccessfulCreate

Created pod: e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-26743a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-26743a-openshift-default-56b6f9f987 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

Created

Container created

openshift-ingress

multus

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 5 to 9

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

Started

Container started

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

ProbeError

Readiness probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Started

Container started

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Unhealthy

Readiness probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Unhealthy

Startup probe failed: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

ProbeError

Startup probe error: Get "http://10.133.0.105:15021/healthz/ready": dial tcp 10.133.0.105:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-26743a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-26743a-openshift-default-56b6f9f987 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-26743a-openshift-default-56b6f9f987

SuccessfulCreate

Created pod: e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-a-695f5c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-695f5c

openshift-ingress

deployment-controller

e2e-api-a-695f5c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-695f5c-openshift-default-94db46fbf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-695f5c-openshift-default-94db46fbf

SuccessfulCreate

Created pod: e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

openshift-ingress

multus

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-695f5c-7698569c67

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-695f5c-7698569c67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-695f5c: serviceaccount "payload-processing-e2e-api-a-695f5c" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-695f5c: serviceaccount "payload-processing-e2e-api-a-695f5c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-695f5c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-695f5c-7698569c67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-695f5c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-695f5c-57cf8874ff from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-695f5c-7698569c67-425hl

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-695f5c-7698569c67-425hl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-695f5c-7698569c67

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-695f5c-7698569c67-425hl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-695f5c-7698569c67-425hl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-695f5c-7698569c67-425hl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl

Started

Container started

openshift-ingress

deployment-controller

e2e-api-a-2d2f63-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2d2f63-openshift-default-786db8c96c from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

openshift-ingress

replicaset-controller

e2e-api-a-2d2f63-openshift-default-786db8c96c

SuccessfulCreate

Created pod: e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

openshift-ingress

gateway_labeler_controller

e2e-api-a-2d2f63

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2d2f63

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

Created

Container created

openshift-ingress

multus

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2d2f63

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2d2f63-7bcbc66bdf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2d2f63

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2d2f63-8659869dff from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

ProbeError

Readiness probe error: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-6w4fl

Unhealthy

Readiness probe failed: Get "https://10.134.0.34:8000/ready": context deadline exceeded

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2d2f63-8659869dff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

Unhealthy

Readiness probe failed: Get "http://10.133.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2d2f63: serviceaccount "payload-processing-e2e-api-a-2d2f63" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2d2f63-8659869dff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2d2f63-8659869dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2d2f63: serviceaccount "payload-processing-e2e-api-a-2d2f63" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

ProbeError

Readiness probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

ProbeError

Readiness probe error: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Unhealthy

Readiness probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Unhealthy

Readiness probe failed: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-6bddq

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6bddq

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6bddq

Started

Container started

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-6bddq

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6bddq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6bddq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6bddq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-f9b7e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f9b7e7

openshift-ingress

replicaset-controller

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7

SuccessfulCreate

Created pod: e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

openshift-ingress

deployment-controller

e2e-api-a-f9b7e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f9b7e7-openshift-default-558b7dc6c7 from 0 to 1

openshift-ingress

multus

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f9b7e7: serviceaccount "payload-processing-e2e-api-a-f9b7e7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f9b7e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f9b7e7-7cc759dd8c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f9b7e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f9b7e7: serviceaccount "payload-processing-e2e-api-a-f9b7e7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

ProbeError

Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

Unhealthy

Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-695f5c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-695f5c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-b-a5f7b9-openshift-default-99f7c85d7

SuccessfulCreate

Created pod: e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

openshift-ingress

deployment-controller

e2e-api-b-a5f7b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a5f7b9-openshift-default-99f7c85d7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-a5f7b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a5f7b9

openshift-ingress

multus

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-4cb675-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4cb675-openshift-default-8685bbd847 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-4cb675

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4cb675

openshift-ingress

replicaset-controller

e2e-api-a-4cb675-openshift-default-8685bbd847

SuccessfulCreate

Created pod: e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

openshift-ingress

multus

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a5f7b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a5f7b9-6bfb557b65 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a5f7b9-6bfb557b65

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a5f7b9-6bfb557b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a5f7b9: serviceaccount "payload-processing-e2e-api-b-a5f7b9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a5f7b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a5f7b9-6bfb557b65

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a5f7b9: serviceaccount "payload-processing-e2e-api-b-a5f7b9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

Unhealthy

Readiness probe failed: Get "http://10.133.0.113:15021/healthz/ready": read tcp 10.133.0.2:41082->10.133.0.113:15021: read: connection reset by peer

opendatahub

kubelet

test-curl-7652-85f34d

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7652-85f34d

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

ProbeError

Readiness probe error: Get "http://10.133.0.113:15021/healthz/ready": read tcp 10.133.0.2:41082->10.133.0.113:15021: read: connection reset by peer body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-695f5c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-695f5c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

Created

Container created

opendatahub

kubelet

test-curl-7652-85f34d

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.36s (1.36s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7652-85f34d

Created

Container created

opendatahub

kubelet

test-curl-7652-85f34d

Started

Container started

opendatahub

kubelet

test-curl-7652-85f34d

Killing

Stopping container test-curl-7652-85f34d

openshift-ingress

gateway_labeler_controller

e2e-api-b-82b62e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-82b62e

openshift-ingress

replicaset-controller

e2e-api-b-82b62e-openshift-default-7dcfbcf48f

SuccessfulCreate

Created pod: e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

openshift-ingress

deployment-controller

e2e-api-b-82b62e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-82b62e-openshift-default-7dcfbcf48f from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4cb675

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4cb675-57b69cd74c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4cb675: serviceaccount "payload-processing-e2e-api-a-4cb675" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4cb675-5c9777bf65

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4cb675-5c9777bf65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4cb675: serviceaccount "payload-processing-e2e-api-a-4cb675" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4cb675-5c9777bf65

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4cb675

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4cb675-5c9777bf65 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2d2f63-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2d2f63-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-82b62e-6c4f666b6c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-82b62e-6c4f666b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-82b62e: serviceaccount "payload-processing-e2e-api-b-82b62e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-82b62e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-82b62e-6c4f666b6c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-82b62e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-82b62e-785f85cc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-82b62e-785f85cc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-82b62e-785f85cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-82b62e: serviceaccount "payload-processing-e2e-api-b-82b62e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-82b62e-6c4f666b6c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-82b62e-785f85cc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4cb675-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4cb675-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2d2f63-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-2d2f63-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-5tn88

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-p5g2x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 9 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-q27sv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-94bt8

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-442wx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-h8dt2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-fkp6p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-b-97f097-openshift-default-589b54574c

SuccessfulCreate

Created pod: e2e-api-b-97f097-openshift-default-589b54574c-469zm

openshift-ingress

gateway_labeler_controller

e2e-api-b-97f097

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-97f097

openshift-ingress

deployment-controller

e2e-api-b-97f097-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-97f097-openshift-default-589b54574c from 0 to 1

openshift-ingress

multus

e2e-api-b-97f097-openshift-default-589b54574c-469zm

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f9b7e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f9b7e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 10 to 9

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-967ql

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-97f097

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-97f097-569869857f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-97f097

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-97f097-66f4b57789 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-97f097-66f4b57789

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-97f097-569869857f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-97f097-569869857f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-97f097-569869857f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-97f097: serviceaccount "payload-processing-e2e-api-b-97f097" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-97f097-66f4b57789

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-97f097-66f4b57789-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-97f097: serviceaccount "payload-processing-e2e-api-b-97f097" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

Unhealthy

Readiness probe failed: Get "http://10.133.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

ProbeError

Readiness probe error: Get "http://10.133.0.119:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 10 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-f7gzq

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-44nfd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

ProbeError

Readiness probe error: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

Unhealthy

Readiness probe failed: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-l8hdj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 9 to 5

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-tsdmd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-fmbzs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-8c5vh

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-q4l6q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

Unhealthy

Readiness probe failed: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-n2vcs

ProbeError

Readiness probe error: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a5f7b9-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-b-a5f7b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a5f7b9-openshift-default-99f7c85d7 from 1 to 2

openshift-ingress

replicaset-controller

e2e-api-b-a5f7b9-openshift-default-99f7c85d7

SuccessfulCreate

Created pod: e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp
(x7)

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-pnsfb
(x7)

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-4c260505-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4c260505-openshift-default-6f77466685 from 1 to 2

openshift-ingress

multus

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-82b62e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

Created

Container created

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-82b62e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4c260505-68cf845c4f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4c260505

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4c260505-68cf845c4f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4c260505-65bb6f8647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4c260505-65bb6f8647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4c260505: serviceaccount "payload-processing-e2e-mt-4c260505" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4c260505-65bb6f8647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4c260505-68cf845c4f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4c260505-68cf845c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4c260505: serviceaccount "payload-processing-e2e-mt-4c260505" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4c260505

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4c260505-65bb6f8647 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-97f097-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-97f097-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 5 to 4

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-4njbs
(x2)

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-2f6bc1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2f6bc1-openshift-default-7bdf5588c9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9

SuccessfulCreate

Created pod: e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

openshift-ingress

gateway_labeler_controller

e2e-api-b-2f6bc1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2f6bc1

openshift-ingress

multus

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a5f7b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a5f7b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-82b62e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-82b62e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tsjp2

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-22jlr

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 6 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-695f5c-57cf8874ff-kxqtl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-695f5c-7698569c67-425hl

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2f6bc1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2f6bc1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a5f7b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a5f7b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2f6bc1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2f6bc1-545476bd69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2f6bc1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2f6bc1-699575b47f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2f6bc1: serviceaccount "payload-processing-e2e-api-b-2f6bc1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2f6bc1-545476bd69

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2f6bc1-545476bd69

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2f6bc1-545476bd69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2f6bc1: serviceaccount "payload-processing-e2e-api-b-2f6bc1" not found

openshift-ingress

multus

payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4cb675-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-4cb675-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-a-2d2f63-7bcbc66bdf-z9gbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2d2f63-8659869dff-n9h9k

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-72zzh

openshift-ingress

deployment-controller

e2e-mt-4c260505-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4c260505-openshift-default-6f77466685 from 2 to 4

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

Created

Container created

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

Started

Container started

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

Created

Container created

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

Started

Container started

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

ProbeError

Startup probe error: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

Unhealthy

Startup probe failed: Get "http://10.132.0.128:15021/healthz/ready": dial tcp 10.132.0.128:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-26743a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-26743a-openshift-default-56b6f9f987 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-26743a-openshift-default-56b6f9f987

SuccessfulDelete

Deleted pod: e2e-worker-w4-26743a-openshift-default-56b6f9f987-9v9mj

openshift-ingress

deployment-controller

e2e-mt-4c260505-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4c260505-openshift-default-6f77466685 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-wcxns

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

AddedInterface

Add eth0 [10.133.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

Started

Container started

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

Created

Container created

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

Created

Container created

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

Started

Container started

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

Created

Container created

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

Started

Container started

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

Started

Container started

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

Unhealthy

Startup probe failed: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

ProbeError

Startup probe error: Get "http://10.133.0.128:15021/healthz/ready": dial tcp 10.133.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

Unhealthy

Readiness probe failed: Get "http://10.133.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

ProbeError

Readiness probe error: Get "http://10.133.0.122:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-mt-4c260505-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4c260505-openshift-default-6f77466685 from 8 to 10

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

(combined from similar events): Created pod: e2e-mt-4c260505-openshift-default-6f77466685-98zzv

openshift-ingress

replicaset-controller

e2e-mt-4c260505-openshift-default-6f77466685

SuccessfulCreate

Created pod: e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-4c260505-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

Started

Container started

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

Created

Container created

opendatahub

kubelet

test-curl-7652-ad1e97

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7652-ad1e97

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7652-ad1e97

Created

Container created

opendatahub

kubelet

test-curl-7652-ad1e97

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

opendatahub

kubelet

test-curl-7652-ad1e97

Killing

Stopping container test-curl-7652-ad1e97
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

Unhealthy

Readiness probe failed: Get "http://10.133.0.124:15021/healthz/ready": read tcp 10.133.0.2:44104->10.133.0.124:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

ProbeError

Readiness probe error: Get "http://10.133.0.124:15021/healthz/ready": read tcp 10.133.0.2:44104->10.133.0.124:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

Created

Container created

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-695f5c-openshift-default-94db46fbf-9c272

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-97f097-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-97f097-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-mt-4c260505-68cf845c4f-xtg4m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4c260505-65bb6f8647-f6h7j

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 10 to 6

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-8m8rx

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-kgdjd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-p84zw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a5f7b9-5b5cfccf87-sq46f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a5f7b9-6bfb557b65-2w4q6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-bpm9h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-btfp8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-btfp8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-bpm9h

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-mrq5j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-mrq5j

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-7bkl6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2f6bc1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-2f6bc1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f9b7e7-5dd9975567-lxq6j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f9b7e7-7cc759dd8c-tww2q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-2d2f63-openshift-default-786db8c96c-q8tjr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 6 to 4

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-d64gb

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-djcgt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-s4ndm

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-s4ndm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-4kb4v

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-4kb4v

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-82b62e-785f85cc9-f6l62

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-82b62e-6c4f666b6c-tbrsz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cb675-5c9777bf65-nntcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cb675-57b69cd74c-tnncg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-f9b7e7-openshift-default-558b7dc6c7-qw2bm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-52f191-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-52f191-openshift-default-6d97c4967c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-52f191

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-52f191

openshift-ingress

replicaset-controller

e2e-api-a-52f191-openshift-default-6d97c4967c

SuccessfulCreate

Created pod: e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-pnsfb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-97f097-66f4b57789-tmjdg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-98zzv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-j6sfz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-vmqvj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-c8mgv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lgjkp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-72zzh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-97f097-569869857f-zthvg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-wcxns

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-lg8h5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4c260505-openshift-default-6f77466685-xdbqw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-52f191

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-52f191-fdd756487 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-52f191

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-52f191-6ccb58fc47 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-52f191-fdd756487

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-52f191-fdd756487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-52f191: serviceaccount "payload-processing-e2e-api-a-52f191" not found

openshift-ingress

multus

payload-processing-e2e-api-a-52f191-fdd756487-t6lgk

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-52f191: serviceaccount "payload-processing-e2e-api-a-52f191" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-52f191-fdd756487

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-52f191-fdd756487-t6lgk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm

openshift-ingress

multus

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-52f191-fdd756487-t6lgk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-52f191-fdd756487-t6lgk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-52f191-fdd756487-t6lgk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-hzrgp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 4 to 3

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-a5f7b9-openshift-default-99f7c85d7-c66kp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-ffq7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-hcscr

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 4 to 2

openshift-ingress

kubelet

e2e-api-a-4cb675-openshift-default-8685bbd847-v7v7l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-wflhj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 4 to 3

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-wvz9k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-82b62e-openshift-default-7dcfbcf48f-mqpm4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-52f191-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-52f191-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-2f6bc1-545476bd69-sg9nz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2f6bc1-699575b47f-w8cht

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f0b8c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f0b8c9

openshift-ingress

deployment-controller

e2e-ipp-a-f0b8c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f0b8c9-openshift-default-85f478b987 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-f0b8c9-openshift-default-85f478b987

SuccessfulCreate

Created pod: e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

openshift-ingress

multus

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f0b8c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f0b8c9-787f8c5877 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f0b8c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0b8c9: serviceaccount "payload-processing-e2e-ipp-a-f0b8c9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0b8c9: serviceaccount "payload-processing-e2e-ipp-a-f0b8c9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv

Created

Container created

openshift-ingress

kubelet

e2e-api-b-97f097-openshift-default-589b54574c-469zm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-65659d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-65659d

openshift-ingress

multus

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-65659d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-65659d-openshift-default-7b95dbfbf7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7

SuccessfulCreate

Created pod: e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-b495h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-jbljg

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5g7qw

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-2cvb2

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-7df854bf67 from 5 to 10

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-wlnm5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-85wfj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-7df854bf67-ksglt

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-wlnm5

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-2cvb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-85wfj

AddedInterface

Add eth0 [10.133.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-2cvb2

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-jbljg

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksglt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksglt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksglt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-2cvb2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-wlnm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-2cvb2

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-7df854bf67-ksglt

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-wlnm5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-wlnm5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-65659d: serviceaccount "payload-processing-e2e-ipp-a-65659d" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-65659d-6475cc7df9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-65659d-6475cc7df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-65659d: serviceaccount "payload-processing-e2e-ipp-a-65659d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-65659d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-65659d-6475cc7df9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-65659d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-65659d-6475cc7df9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv

openshift-ingress

gateway_labeler_controller

e2e-api-b-a3aa65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a3aa65

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-a3aa65-openshift-default-57649d9c

SuccessfulCreate

Created pod: e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7

Started

Container started

openshift-ingress

deployment-controller

e2e-api-b-a3aa65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a3aa65-openshift-default-57649d9c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-wlnm5

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksglt

ProbeError

Startup probe error: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-wlnm5

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksglt

Unhealthy

Startup probe failed: Get "http://10.132.0.143:15021/healthz/ready": dial tcp 10.132.0.143:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-2cvb2

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-2cvb2

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": dial tcp 10.133.0.135:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

ProbeError

Startup probe error: Get "http://10.133.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

Unhealthy

Startup probe failed: Get "http://10.133.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a3aa65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a3aa65-544599d96c from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-26743a-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-26743a-openshift-default-56b6f9f987 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-26743a-openshift-default-56b6f9f987

SuccessfulDelete

Deleted pod: e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a3aa65-544599d96c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a3aa65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a3aa65: serviceaccount "payload-processing-e2e-api-b-a3aa65" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a3aa65-544599d96c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a3aa65-544599d96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a3aa65: serviceaccount "payload-processing-e2e-api-b-a3aa65" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-pbk5s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

Unhealthy

Readiness probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-gv94x

ProbeError

Readiness probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-52f191-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-52f191-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-2f6bc1-openshift-default-7bdf5588c9-tcwfh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a4257d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a4257d

openshift-ingress

deployment-controller

e2e-ipp-a-a4257d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a4257d-openshift-default-76f5d56dc7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7

SuccessfulCreate

Created pod: e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-95b84c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-95b84c

openshift-ingress

replicaset-controller

e2e-ipp-a-95b84c-openshift-default-68fd98686f

SuccessfulCreate

Created pod: e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

openshift-ingress

deployment-controller

e2e-ipp-a-95b84c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-95b84c-openshift-default-68fd98686f from 0 to 1

openshift-ingress

multus

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a4257d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a4257d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a4257d-54486d8c5f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a4257d-54486d8c5f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a4257d-54486d8c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a4257d: serviceaccount "payload-processing-e2e-ipp-a-a4257d" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a4257d: serviceaccount "payload-processing-e2e-ipp-a-a4257d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a4257d-54486d8c5f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr

openshift-ingress

multus

payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0b8c9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0b8c9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

ProbeError

Startup probe error: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

Unhealthy

Startup probe failed: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-95b84c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-95b84c: serviceaccount "payload-processing-e2e-ipp-a-95b84c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-95b84c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-95b84c-5fddcc88bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-95b84c: serviceaccount "payload-processing-e2e-ipp-a-95b84c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z

AddedInterface

Add eth0 [10.132.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-787f8c5877-kdtgz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-79d9577847-4wpgv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-65659d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-65659d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

ProbeError

Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

Unhealthy

Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0b8c9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-f0b8c9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a3aa65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a3aa65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-6475cc7df9-pw9qv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-79df5b7dcf-n6tw7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a3aa65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a3aa65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-65659d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-65659d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f0b8c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f0b8c9-8596bff786 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f0b8c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-52f191-fdd756487-t6lgk

Killing

Stopping container payload-processing
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0b8c9: serviceaccount "payload-processing-e2e-ipp-a-f0b8c9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-52f191-6ccb58fc47-sdzsm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0b8c9-8596bff786

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f0b8c9-8596bff786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f0b8c9: serviceaccount "payload-processing-e2e-ipp-a-f0b8c9" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f0b8c9-8596bff786

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

Unhealthy

Startup probe failed: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

ProbeError

Startup probe error: Get "http://10.133.0.141:15021/healthz/ready": dial tcp 10.133.0.141:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.828s (1.828s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.544s (1.544s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-vhn52

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-65659d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-65659d-5f7d854c44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-65659d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-65659d-5f7d854c44

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-65659d-5f7d854c44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-65659d: serviceaccount "payload-processing-e2e-ipp-a-65659d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-65659d: serviceaccount "payload-processing-e2e-ipp-a-65659d" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-65659d-5f7d854c44

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a4257d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a4257d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-95b84c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-95b84c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

openshift-ingress

replicaset-controller

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc

SuccessfulCreate

Created pod: e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

openshift-ingress

deployment-controller

e2e-ipp-b-c4bfac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c4bfac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c4bfac
(x5)

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zjvbf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5

SuccessfulCreate

Created pod: e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

openshift-ingress

deployment-controller

e2e-ipp-b-5d2b13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5d2b13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5d2b13

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

BackOff

Back-off restarting failed container payload-processing in pod payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7_openshift-ingress(a26faa2b-bfec-4c15-9f2f-e029abf94670)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-54486d8c5f-7fpkr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-694cc756bc-jd5z5

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c4bfac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c4bfac-d858f6565 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c4bfac: serviceaccount "payload-processing-e2e-ipp-b-c4bfac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c4bfac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c4bfac-d858f6565

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c4bfac-d858f6565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c4bfac: serviceaccount "payload-processing-e2e-ipp-b-c4bfac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c4bfac-d858f6565

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d2b13: serviceaccount "payload-processing-e2e-ipp-b-5d2b13" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5d2b13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-138566

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-138566
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d2b13: serviceaccount "payload-processing-e2e-ipp-b-5d2b13" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5d2b13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5fddcc88bc-7vp7z

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-138566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-138566-openshift-default-7f89f7669f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2

openshift-ingress

replicaset-controller

e2e-ipp-b-138566-openshift-default-7f89f7669f

SuccessfulCreate

Created pod: e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-66d7f7f659-xggxv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes
(x3)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

Started

Container started
(x3)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-95b84c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-95b84c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-138566

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-138566-664cc54b9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-138566: serviceaccount "payload-processing-e2e-ipp-b-138566" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-138566-664cc54b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-138566-664cc54b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-138566-664cc54b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-138566: serviceaccount "payload-processing-e2e-ipp-b-138566" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-138566

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-fe745d-openshift-default-7979c65b59

SuccessfulCreate

Created pod: e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

openshift-ingress

deployment-controller

e2e-ipp-b-fe745d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-fe745d-openshift-default-7979c65b59 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-fe745d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-fe745d

openshift-ingress

multus

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe745d-5db6565677

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-fe745d-5db6565677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe745d: serviceaccount "payload-processing-e2e-ipp-b-fe745d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-fe745d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-fe745d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-fe745d-5db6565677 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe745d: serviceaccount "payload-processing-e2e-ipp-b-fe745d" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe745d-5db6565677

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb

Created

Container created

openshift-ingress

kubelet

e2e-api-a-52f191-openshift-default-6d97c4967c-gd5qh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a4257d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a4257d-c6b8d878d from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a4257d: serviceaccount "payload-processing-e2e-ipp-a-a4257d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a4257d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a4257d-c48cd847 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a4257d-c6b8d878d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a4257d-c6b8d878d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a4257d: serviceaccount "payload-processing-e2e-ipp-a-a4257d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a4257d-c6b8d878d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.501s (2.501s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a3aa65-6bc6fb5f5f-m7k7m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a3aa65-544599d96c-pf4fs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-95b84c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-95b84c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-95b84c: serviceaccount "payload-processing-e2e-ipp-a-95b84c" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-95b84c: serviceaccount "payload-processing-e2e-ipp-a-95b84c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

ProbeError

Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Unhealthy

Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d2b13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d2b13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c4bfac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c4bfac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d2b13-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5d2b13-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

ProbeError

Startup probe error: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

Unhealthy

Startup probe failed: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c4bfac-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c4bfac-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-5fbd49cb5f-7d7pm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-d858f6565-wfcd7

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-138566-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-138566-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe745d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe745d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-57b779467f-tkc7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-5c85fcfd85-mqgq2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-138566-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-138566-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-7d49cb8c99-sjw5z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-664cc54b9-r2tvn

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-2cvb2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-jbljg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-jbljg
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7df854bf67 from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-85wfj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-85wfj

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-2cvb2

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe745d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe745d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-76cdc9998c-zgb6l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-5db6565677-b4rwb

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c4bfac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c4bfac-6785856954 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c4bfac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c4bfac-6785856954

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c4bfac-6785856954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c4bfac: serviceaccount "payload-processing-e2e-ipp-b-c4bfac" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c4bfac: serviceaccount "payload-processing-e2e-ipp-b-c4bfac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c4bfac-6785856954

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4

Created

Container created

openshift-ingress

kubelet

e2e-api-b-a3aa65-openshift-default-57649d9c-657f7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-63a282-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-63a282-openshift-default-7b6c7d9667 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-63a282-openshift-default-7b6c7d9667

SuccessfulCreate

Created pod: e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-63a282

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-63a282

openshift-ingress

multus

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5d2b13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d2b13: serviceaccount "payload-processing-e2e-ipp-b-5d2b13" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5d2b13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5d2b13: serviceaccount "payload-processing-e2e-ipp-b-5d2b13" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g

openshift-ingress

multus

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-63a282

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-63a282-5978dfffdf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-63a282-6c49469979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-63a282-6c49469979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-63a282: serviceaccount "payload-processing-e2e-ipp-a-63a282" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-63a282-5978dfffdf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-63a282-5978dfffdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-63a282: serviceaccount "payload-processing-e2e-ipp-a-63a282" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-63a282

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-63a282-6c49469979 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-63a282-6c49469979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-63a282-5978dfffdf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-63a282-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-63a282-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-138566

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-138566-6ffd477879 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-138566

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-138566-869577984b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-138566-869577984b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-138566-869577984b-lbbd7
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-138566-6ffd477879

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-138566-6ffd477879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-138566: serviceaccount "payload-processing-e2e-ipp-b-138566" not found
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-138566-869577984b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-138566-869577984b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-138566: serviceaccount "payload-processing-e2e-ipp-b-138566" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-138566-869577984b-lbbd7

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-869577984b-lbbd7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-869577984b-lbbd7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-869577984b-lbbd7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-138566-6ffd477879

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-fe745d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-fe745d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-fe745d-85cf688ff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe745d-85cf688ff4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe745d-85cf688ff4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-fe745d-85cf688ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe745d: serviceaccount "payload-processing-e2e-ipp-b-fe745d" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe745d: serviceaccount "payload-processing-e2e-ipp-b-fe745d" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4257d-c48cd847-7s2vs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4257d-c6b8d878d-kr4t7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-95b84c-5dd7c4f69b-9hh5j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-95b84c-5459cb9787-q2thp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-a4257d-openshift-default-76f5d56dc7-ctck7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

Unhealthy

Readiness probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-95b84c-openshift-default-68fd98686f-phw5w

ProbeError

Readiness probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f0b8c9-8596bff786-z4bv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f0b8c9-c999d578c-dz97r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-138566-869577984b-lbbd7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-138566-6ffd477879-wbs5f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-138566-openshift-default-7f89f7669f-jlkr4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f0b8c9-openshift-default-85f478b987-txjkj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-3cecc7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-3cecc7

openshift-ingress

deployment-controller

e2e-praxis-a-3cecc7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-3cecc7-openshift-default-668489bb6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-3cecc7-openshift-default-668489bb6f

SuccessfulCreate

Created pod: e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-7df854bf67-wlnm5

openshift-ingress

multus

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7df854bf67 from 7 to 5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-65659d-55c9cfbc9f-vxmf4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksglt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-65659d-5f7d854c44-bbgk7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-wlnm5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-3cecc7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-3cecc7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-3cecc7-58766fc779 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3cecc7-58766fc779

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-3cecc7-58766fc779

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-3cecc7-58766fc779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3cecc7: serviceaccount "payload-processing-e2e-praxis-a-3cecc7" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-3cecc7: serviceaccount "payload-processing-e2e-praxis-a-3cecc7" not found

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-5k9wk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-65659d-openshift-default-7b95dbfbf7-87stk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-6bddq

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-6bddq

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-qwsns

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-x8nz5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4bfac-6785856954-ffst9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4bfac-7f546785c5-6z6b4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5d2b13-65f7fdf4d6-mwhzz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5d2b13-54dc6f8fd7-kf98g

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

Unhealthy

Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

ProbeError

Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-c4bfac-openshift-default-67fb85b5bc-tf856

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ca6d0b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ca6d0b

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-ca6d0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ca6d0b-openshift-default-7677b768f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7

SuccessfulCreate

Created pod: e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

openshift-ingress

multus

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-5d2b13-openshift-default-7879d6b5c5-t9ksk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-6c49469979-hf22h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-5978dfffdf-wtlnf

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f4a424

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f4a424

openshift-ingress

deployment-controller

e2e-praxis-a-f4a424-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f4a424-openshift-default-79f48d97b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d2f1cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d2f1cf

openshift-ingress

replicaset-controller

e2e-praxis-a-f4a424-openshift-default-79f48d97b5

SuccessfulCreate

Created pod: e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

openshift-ingress

deployment-controller

e2e-ipp-b-d2f1cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f

SuccessfulCreate

Created pod: e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

openshift-ingress

multus

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ca6d0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ca6d0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ca6d0b: serviceaccount "payload-processing-e2e-praxis-a-ca6d0b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ca6d0b: serviceaccount "payload-processing-e2e-praxis-a-ca6d0b" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d2f1cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d2f1cf: serviceaccount "payload-processing-e2e-ipp-b-d2f1cf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d2f1cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d2f1cf-699959cbc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d2f1cf: serviceaccount "payload-processing-e2e-ipp-b-d2f1cf" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f4a424

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f4a424

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f4a424-59c8b96697 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f4a424: serviceaccount "payload-processing-e2e-praxis-a-f4a424" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f4a424-59c8b96697

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe745d-85cf688ff4-xh6cf

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe745d-b94fb6ff9-pb9cj

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f4a424-59c8b96697

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f4a424-59c8b96697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f4a424: serviceaccount "payload-processing-e2e-praxis-a-f4a424" not found

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7df854bf67 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-6ljr6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-63a282-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-63a282-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-fe745d-openshift-default-7979c65b59-p76d2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f7c488

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f7c488

openshift-ingress

deployment-controller

e2e-praxis-a-f7c488-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f7c488-openshift-default-54468fb977 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-f7c488-openshift-default-54468fb977

SuccessfulCreate

Created pod: e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

openshift-ingress

multus

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca6d0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca6d0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f7c488

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f7c488-8f5b95d7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f7c488-8f5b95d7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f7c488-8f5b95d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f7c488: serviceaccount "payload-processing-e2e-praxis-a-f7c488" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f7c488

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f7c488: serviceaccount "payload-processing-e2e-praxis-a-f7c488" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f7c488-8f5b95d7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-63a282

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-63a282-6fd5799d6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-63a282

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

Created

Container created
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-63a282: serviceaccount "payload-processing-e2e-ipp-a-63a282" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-63a282-6fd5799d6b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-63a282-6fd5799d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-63a282: serviceaccount "payload-processing-e2e-ipp-a-63a282" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-63a282-6fd5799d6b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3cecc7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-3cecc7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-85d00c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-85d00c

openshift-ingress

deployment-controller

e2e-praxis-b-85d00c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-85d00c-openshift-default-7699c795d9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-85d00c-openshift-default-7699c795d9

SuccessfulCreate

Created pod: e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4a424-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4a424-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d2f1cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d2f1cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-85d00c-58cf887765

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-85d00c-58cf887765-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-85d00c: serviceaccount "payload-processing-e2e-praxis-b-85d00c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-85d00c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-85d00c-58cf887765 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-85d00c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-85d00c: serviceaccount "payload-processing-e2e-praxis-b-85d00c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-85d00c-58cf887765

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca6d0b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ca6d0b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7df854bf67 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-pwbsh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-praxis-a-f7c488-openshift-default-54468fb977

SuccessfulCreate

Created pod: e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

Created

Container created

openshift-ingress

multus

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-f7c488-openshift-default-54468fb977

SuccessfulCreate

Created pod: e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

openshift-ingress

deployment-controller

e2e-praxis-a-f7c488-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f7c488-openshift-default-54468fb977 from 1 to 3

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-fc3918

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-fc3918

openshift-ingress

deployment-controller

e2e-praxis-b-fc3918-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-fc3918-openshift-default-86455f997 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-fc3918-openshift-default-86455f997

SuccessfulCreate

Created pod: e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4a424-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f4a424-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d2f1cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-d2f1cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

Unhealthy

Startup probe failed: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

ProbeError

Startup probe error: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

Unhealthy

Startup probe failed: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

ProbeError

Startup probe error: Get "http://10.132.0.207:15021/healthz/ready": dial tcp 10.132.0.207:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-fc3918

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-fc3918

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-fc3918-585f79b757 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fc3918-585f79b757

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-fc3918-585f79b757

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-fc3918-585f79b757-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fc3918: serviceaccount "payload-processing-e2e-praxis-b-fc3918" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-fc3918: serviceaccount "payload-processing-e2e-praxis-b-fc3918" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-9f4586f9-spt2n

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-699959cbc9-6lglm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-93131d-openshift-default-6b4b88f469

SuccessfulCreate

Created pod: e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

openshift-ingress

deployment-controller

e2e-praxis-b-93131d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-93131d-openshift-default-6b4b88f469 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-93131d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-93131d

openshift-ingress

multus

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-93131d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-93131d-58db56c5dc from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f7c488-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-93131d-58db56c5dc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-93131d-58db56c5dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-93131d: serviceaccount "payload-processing-e2e-praxis-b-93131d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f7c488-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-93131d: serviceaccount "payload-processing-e2e-praxis-b-93131d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-93131d-58db56c5dc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-93131d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc3918-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc3918-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-7fd427

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-7fd427

openshift-ingress

deployment-controller

e2e-praxis-b-7fd427-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-7fd427-openshift-default-86d6585d9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-7fd427-openshift-default-86d6585d9c

SuccessfulCreate

Created pod: e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

openshift-ingress

multus

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7fd427-76f9ff478f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-7fd427

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7fd427: serviceaccount "payload-processing-e2e-praxis-b-7fd427" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-7fd427

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-7fd427-76f9ff478f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-7fd427-76f9ff478f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-7fd427-76f9ff478f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-7fd427: serviceaccount "payload-processing-e2e-praxis-b-7fd427" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d2f1cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d2f1cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d2f1cf-69dd76d744 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d2f1cf: serviceaccount "payload-processing-e2e-ipp-b-d2f1cf" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d2f1cf: serviceaccount "payload-processing-e2e-ipp-b-d2f1cf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz

AddedInterface

Add eth0 [10.132.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-b-85d00c-openshift-default-7699c795d9

SuccessfulCreate

Created pod: e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw
(x2)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-85d00c-openshift-default-7699c795d9

SuccessfulCreate

Created pod: e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-85d00c-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-b-85d00c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-85d00c-openshift-default-7699c795d9 from 1 to 3
(x2)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

Started

Container started

openshift-ingress

multus

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

Unhealthy

Startup probe failed: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

ProbeError

Startup probe error: Get "http://10.132.0.215:15021/healthz/ready": dial tcp 10.132.0.215:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-85d00c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-85d00c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-85d00c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-85d00c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

Unhealthy

Readiness probe failed: Get "http://10.133.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

ProbeError

Readiness probe error: Get "http://10.133.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

Unhealthy

Startup probe failed: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

ProbeError

Startup probe error: Get "http://10.133.0.166:15021/healthz/ready": dial tcp 10.133.0.166:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc3918-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-fc3918-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-3cecc7-58766fc779-v6psr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-3cecc7-fd5cb8f47-f84ft

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-93131d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-93131d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-93131d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-93131d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

ProbeError

Readiness probe error: Get "http://10.133.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Unhealthy

Readiness probe failed: Get "http://10.133.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

ProbeError

Startup probe error: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Unhealthy

Startup probe failed: Get "http://10.133.0.167:15021/healthz/ready": dial tcp 10.133.0.167:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-3cecc7-openshift-default-668489bb6f-4vplb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7fd427-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7fd427-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ca6d0b-6968c74b4c-qvhdj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ca6d0b-5945897d99-27l2k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-85d00c-58cf887765-d2kzd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-85d00c-7b469766d7-zcrgc

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7fd427-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-7fd427-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-rmdxg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-7srqw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-85d00c-openshift-default-7699c795d9-zft7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f4a424-59c8b96697-gs4g4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f4a424-7d85fbf855-nqncv

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7df854bf67 from 3 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-lpfj5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-a-ca6d0b-openshift-default-7677b768f7-cgh8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

ProbeError

Readiness probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-fc3918-585f79b757-nzmct

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-f4a424-openshift-default-79f48d97b5-sgwh5

Unhealthy

Readiness probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-fc3918-6f76c98cdc-gcdk4

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.208:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-93131d-58db56c5dc-zq5vx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-93131d-7c7b47dd47-9j7hc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-fc3918-openshift-default-86455f997-9mnxx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-93131d-openshift-default-6b4b88f469-977r9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f7c488-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-f7c488-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-praxis-a-f7c488-openshift-default-54468fb977 from 3 to 2

openshift-ingress

replicaset-controller

e2e-praxis-a-f7c488-openshift-default-54468fb977

SuccessfulDelete

Deleted pod: e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-63a282-6fd5799d6b-5swml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-63a282-85bbb794f9-rrrl9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ct8l8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-63a282-openshift-default-7b6c7d9667-79fv2

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-7df854bf67

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-7df854bf67-ksw98

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-7df854bf67-ksw98

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-7df854bf67 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d2f1cf-bd68dfd75-njtbz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d2f1cf-69dd76d744-nfc59

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 3 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

AddedInterface

Add eth0 [10.133.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

Unhealthy

Startup probe failed: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

ProbeError

Startup probe error: Get "http://10.133.0.170:15021/healthz/ready": dial tcp 10.133.0.170:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-d2f1cf-openshift-default-7bddd68c6f-vj7xr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f7c488-8f5b95d7-5zffn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f7c488-664c5d8875-bjnxd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

AddedInterface

Add eth0 [10.132.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

ProbeError

Startup probe error: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

Unhealthy

Startup probe failed: Get "http://10.132.0.248:15021/healthz/ready": dial tcp 10.132.0.248:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-5e884c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5e884c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5e884c

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf

SuccessfulCreate

Created pod: e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

openshift-ingress

multus

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-43d592

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-43d592

openshift-ingress

multus

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-43d592-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-43d592-openshift-default-89674766c from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-43d592-openshift-default-89674766c

SuccessfulCreate

Created pod: e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulCreate

Created pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 4 to 8

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulCreate

Created pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

Started

Container started

openshift-ingress

multus

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5e884c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5e884c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5e884c: serviceaccount "payload-processing-e2e-shared-a-w2-5e884c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5e884c: serviceaccount "payload-processing-e2e-shared-a-w2-5e884c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

AddedInterface

Add eth0 [10.132.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

Created

Container created

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

Started

Container started
(x3)

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulCreate

Created pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

Unhealthy

Startup probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

ProbeError

Startup probe error: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

Unhealthy

Startup probe failed: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

ProbeError

Startup probe error: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

Unhealthy

Startup probe failed: Get "http://10.132.0.253:15021/healthz/ready": dial tcp 10.132.0.253:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

Unhealthy

Startup probe failed: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

Created

Container created

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

AddedInterface

Add eth0 [10.132.1.1/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

ProbeError

Startup probe error: Get "http://10.133.0.174:15021/healthz/ready": dial tcp 10.133.0.174:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

ProbeError

Startup probe error: Get "http://10.132.0.254:15021/healthz/ready": dial tcp 10.132.0.254:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

ProbeError

Startup probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

Unhealthy

Startup probe failed: Get "http://10.134.0.106:15021/healthz/ready": dial tcp 10.134.0.106:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

Unhealthy

Startup probe failed: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

ProbeError

Startup probe error: Get "http://10.132.1.0:15021/healthz/ready": dial tcp 10.132.1.0:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

Unhealthy

Startup probe failed: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

ProbeError

Startup probe error: Get "http://10.132.1.1:15021/healthz/ready": dial tcp 10.132.1.1:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

ProbeError

Readiness probe error: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

Unhealthy

Readiness probe failed: Get "http://10.133.0.171:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

ProbeError

Startup probe error: Get "http://10.132.1.1:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-shared-a-w1-ef00a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-ef00a4-openshift-default-8d489689c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-ef00a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-ef00a4

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

Unhealthy

Startup probe failed: Get "http://10.132.1.1:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c

SuccessfulCreate

Created pod: e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-43d592

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-43d592: serviceaccount "payload-processing-e2e-shared-a-w3-43d592" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-43d592

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-43d592-6cf85b6645 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-43d592: serviceaccount "payload-processing-e2e-shared-a-w3-43d592" not found

openshift-ingress

multus

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-6fc60c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-6fc60c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

openshift-ingress

replicaset-controller

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f

SuccessfulCreate

Created pod: e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

openshift-ingress

deployment-controller

e2e-shared-a-w0-6fc60c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-6fc60c: serviceaccount "payload-processing-e2e-shared-a-w0-6fc60c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-6fc60c: serviceaccount "payload-processing-e2e-shared-a-w0-6fc60c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-6fc60c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-6fc60c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp

AddedInterface

Add eth0 [10.132.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-ef00a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-ef00a4: serviceaccount "payload-processing-e2e-shared-a-w1-ef00a4" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f7c488-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-f7c488-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f7c488-openshift-default-54468fb977 from 2 to 3

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-ef00a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-f7c488-openshift-default-54468fb977

SuccessfulCreate

Created pod: e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-ef00a4: serviceaccount "payload-processing-e2e-shared-a-w1-ef00a4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

AddedInterface

Add eth0 [10.132.1.3/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lf2mr

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

AddedInterface

Add eth0 [10.132.1.4/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulCreate

Created pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

Started

Container started

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

AddedInterface

Add eth0 [10.133.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

Unhealthy

Startup probe failed: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

Unhealthy

Startup probe failed: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

ProbeError

Startup probe error: Get "http://10.132.1.5:15021/healthz/ready": dial tcp 10.132.1.5:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

ProbeError

Startup probe error: Get "http://10.133.0.180:15021/healthz/ready": dial tcp 10.133.0.180:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

Unhealthy

Startup probe failed: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

ProbeError

Startup probe error: Get "http://10.133.0.182:15021/healthz/ready": dial tcp 10.133.0.182:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

ProbeError

Startup probe error: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

Unhealthy

Startup probe failed: Get "http://10.133.0.181:15021/healthz/ready": dial tcp 10.133.0.181:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-zglgl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-dj64q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-f7c488-openshift-default-54468fb977-ndd7k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-5e884c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-5e884c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

Unhealthy

Startup probe failed: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

ProbeError

Startup probe error: Get "http://10.133.0.172:15021/healthz/ready": dial tcp 10.133.0.172:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-7fd427-6474fb8df5-4xlvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-7fd427-76f9ff478f-74rw2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

Unhealthy

Readiness probe failed: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

ProbeError

Readiness probe error: Get "http://10.133.0.179:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-5e884c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-5e884c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

ProbeError

Startup probe error: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

Unhealthy

Startup probe failed: Get "http://10.133.0.173:15021/healthz/ready": dial tcp 10.133.0.173:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

ProbeError

Startup probe error: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

Unhealthy

Startup probe failed: Get "http://10.133.0.179:15021/healthz/ready": dial tcp 10.133.0.179:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-5bb0b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5bb0b1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65

SuccessfulCreate

Created pod: e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

openshift-ingress

deployment-controller

e2e-shared-b-w2-5bb0b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-5bb0b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-ae7a1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-ae7a1f
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5bb0b1: serviceaccount "payload-processing-e2e-shared-b-w2-5bb0b1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-5bb0b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5bb0b1: serviceaccount "payload-processing-e2e-shared-b-w2-5bb0b1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c

SuccessfulCreate

Created pod: e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

openshift-ingress

deployment-controller

e2e-shared-b-w3-ae7a1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

AddedInterface

Add eth0 [10.132.1.14/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

AddedInterface

Add eth0 [10.132.1.15/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

AddedInterface

Add eth0 [10.133.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

ProbeError

Readiness probe error: Get "http://10.133.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

Unhealthy

Readiness probe failed: Get "http://10.133.0.176:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-7fd427-openshift-default-86d6585d9c-v2cbz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-ae7a1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ae7a1f: serviceaccount "payload-processing-e2e-shared-b-w3-ae7a1f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-ae7a1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-ae7a1f: serviceaccount "payload-processing-e2e-shared-b-w3-ae7a1f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

AddedInterface

Add eth0 [10.132.1.16/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

Unhealthy

Startup probe failed: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl

AddedInterface

Add eth0 [10.132.1.17/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

ProbeError

Startup probe error: Get "http://10.133.0.176:15021/healthz/ready": dial tcp 10.133.0.176:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-43d592-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-43d592-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-ef00a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-ef00a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6fc60c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-6fc60c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w0-c29159-openshift-default-76db59dbc

SuccessfulCreate

Created pod: e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

openshift-ingress

deployment-controller

e2e-shared-b-w0-c29159-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-c29159-openshift-default-76db59dbc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-c29159

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-c29159

openshift-ingress

multus

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w1-323082-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-323082-openshift-default-78f46c58c5 from 0 to 1

openshift-ingress

deployment-controller

e2e-explicit-355213-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-355213-openshift-default-6f7c585497 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-355213-openshift-default-6f7c585497

SuccessfulCreate

Created pod: e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

openshift-ingress

replicaset-controller

e2e-shared-b-w1-323082-openshift-default-78f46c58c5

SuccessfulCreate

Created pod: e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-323082

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-323082

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-c29159

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-c29159-c798bb7d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-355213

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-355213

openshift-ingress

multus

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

openshift-ingress

multus

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-c29159

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-c29159: serviceaccount "payload-processing-e2e-shared-b-w0-c29159" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-c29159: serviceaccount "payload-processing-e2e-shared-b-w0-c29159" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

AddedInterface

Add eth0 [10.132.1.18/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

AddedInterface

Add eth0 [10.132.1.19/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae7a1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-ef00a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae7a1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-ef00a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-355213

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-355213-7457cdd947 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-355213

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-355213-6bdf467d8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-355213-6bdf467d8c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-355213-7457cdd947

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-355213-7457cdd947

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-355213-7457cdd947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-355213: serviceaccount "payload-processing-e2e-explicit-355213" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-355213-6bdf467d8c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-355213-6bdf467d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-355213: serviceaccount "payload-processing-e2e-explicit-355213" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz

AddedInterface

Add eth0 [10.132.1.21/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc

AddedInterface

Add eth0 [10.132.1.20/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-323082

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-323082

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

AddedInterface

Add eth0 [10.132.1.22/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-323082: serviceaccount "payload-processing-e2e-shared-b-w1-323082" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-323082: serviceaccount "payload-processing-e2e-shared-b-w1-323082" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx

AddedInterface

Add eth0 [10.132.1.23/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-355213-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-355213-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

Unhealthy

Startup probe failed: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

ProbeError

Startup probe error: Get "http://10.133.0.187:15021/healthz/ready": dial tcp 10.133.0.187:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-explicit-355213-openshift-default-6f7c585497

SuccessfulCreate

Created pod: e2e-explicit-355213-openshift-default-6f7c585497-62cld

openshift-ingress

deployment-controller

e2e-explicit-355213-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-355213-openshift-default-6f7c585497 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-355213-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-62cld

Started

Container started

openshift-ingress

multus

e2e-explicit-355213-openshift-default-6f7c585497-62cld

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-62cld

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-62cld

Created

Container created

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

ProbeError

Readiness probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

Unhealthy

Readiness probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-62cld

ProbeError

Startup probe error: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-62cld

Unhealthy

Startup probe failed: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c29159-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c29159-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

Unhealthy

Startup probe failed: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

ProbeError

Startup probe error: Get "http://10.133.0.188:15021/healthz/ready": dial tcp 10.133.0.188:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

ProbeError

Readiness probe error: Get "http://10.134.0.117:15021/healthz/ready": read tcp 10.134.0.2:48634->10.134.0.117:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Unhealthy

Readiness probe failed: Get "http://10.134.0.117:15021/healthz/ready": read tcp 10.134.0.2:48634->10.134.0.117:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-355213-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-355213-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

ProbeError

Startup probe error: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Unhealthy

Startup probe failed: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae7a1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-ae7a1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5bb0b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5bb0b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

Unhealthy

Readiness probe failed: Get "http://10.133.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

ProbeError

Readiness probe error: Get "http://10.133.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c29159-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-c29159-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5bb0b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5bb0b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-323082-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-323082-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-323082-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-323082-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6
(x2)

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 3 to 2

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 8 to 7

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5dpq6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xtgnv
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-gfc4n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 7 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-vhcmg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-s4kll

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-m62w4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-ph4rz

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-cn6j2

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-26fds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-69bpz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-l4xqf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-8j4r8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-explicit-355213-6bdf467d8c-6wmnc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-355213-7457cdd947-pxhhz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-62cld

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-355213-openshift-default-6f7c585497-dpv7l

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-970415

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-970415

openshift-ingress

replicaset-controller

e2e-noten-970415-openshift-default-658c8594d5

SuccessfulCreate

Created pod: e2e-noten-970415-openshift-default-658c8594d5-rddlq

openshift-ingress

deployment-controller

e2e-noten-970415-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-970415-openshift-default-658c8594d5 from 0 to 1

openshift-ingress

multus

e2e-noten-970415-openshift-default-658c8594d5-rddlq

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-970415-openshift-default-658c8594d5-rddlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-970415-openshift-default-658c8594d5-rddlq

Created

Container created

openshift-ingress

kubelet

e2e-noten-970415-openshift-default-658c8594d5-rddlq

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5bb0b1-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w2-5bb0b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65 from 1 to 2

openshift-ingress

multus

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65

SuccessfulCreate

Created pod: e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-970415-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-970415-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w2-56f3fe-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-56f3fe-openshift-default-784cd69b87 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-5zjwt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-56f3fe-openshift-default-784cd69b87

SuccessfulDelete

Deleted pod: e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 3 to 2

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-56f3fe-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-ck8v8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-t9xlf

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

Unhealthy

Readiness probe failed: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c

SuccessfulDelete

Deleted pod: e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-g2zf4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-tqqzb

ProbeError

Readiness probe error: Get "http://10.133.0.174:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w0-9a5623-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9a5623-openshift-default-5455ff6b5c from 2 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9a5623-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lf2mr

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-lf2mr

openshift-ingress

kubelet

e2e-noten-970415-openshift-default-658c8594d5-rddlq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-970415-openshift-default-658c8594d5-rddlq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-970415-openshift-default-658c8594d5-rddlq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-rv4nt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7664-453970

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7664-453970

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7664-453970

Created

Container created

opendatahub

kubelet

test-curl-7664-453970

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.932s (3.932s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7664-453970

Started

Container started

opendatahub

multus

test-curl-7664-33eafa

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7664-33eafa

Started

Container started

opendatahub

kubelet

test-curl-7664-33eafa

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7664-33eafa

Created

Container created

opendatahub

kubelet

test-curl-7664-453970

Killing

Stopping container test-curl-7664-453970

opendatahub

kubelet

test-curl-7664-33eafa

Killing

Stopping container test-curl-7664-33eafa

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-03e614

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-03e614

openshift-ingress

deployment-controller

e2e-shared-a-w4-03e614-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-03e614-openshift-default-5c57894957 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-03e614-openshift-default-5c57894957

SuccessfulCreate

Created pod: e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

openshift-ingress

multus

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-03e614

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-03e614-86546c967 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-03e614

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-03e614-5f847dd695 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-03e614-5f847dd695

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-03e614-5f847dd695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-03e614: serviceaccount "payload-processing-e2e-shared-a-w4-03e614" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-03e614-5f847dd695

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-03e614: serviceaccount "payload-processing-e2e-shared-a-w4-03e614" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f

SuccessfulDelete

Deleted pod: e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-4d14e0-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-4d14e0-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-k5brt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-7658-9bc8f7

AddedInterface

Add eth0 [10.132.1.33/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7658-9bc8f7

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7658-9bc8f7

Created

Container created

opendatahub

kubelet

test-curl-7658-9bc8f7

Started

Container started

opendatahub

kubelet

test-curl-7658-9bc8f7

Killing

Stopping container test-curl-7658-9bc8f7

opendatahub

kubelet

test-curl-7658-9d8cc3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7658-9d8cc3

Started

Container started

opendatahub

kubelet

test-curl-7658-9d8cc3

Created

Container created

opendatahub

multus

test-curl-7658-9d8cc3

AddedInterface

Add eth0 [10.132.1.34/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7658-9d8cc3

Killing

Stopping container test-curl-7658-9d8cc3

opendatahub

kubelet

test-curl-7658-8e7216

Started

Container started

opendatahub

kubelet

test-curl-7658-8e7216

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7658-8e7216

Created

Container created

opendatahub

multus

test-curl-7658-8e7216

AddedInterface

Add eth0 [10.132.1.35/23] from ovn-kubernetes

opendatahub

multus

test-curl-7658-11fc4d

AddedInterface

Add eth0 [10.132.1.37/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7658-11fc4d

Started

Container started

opendatahub

kubelet

test-curl-7658-11fc4d

Created

Container created

opendatahub

kubelet

test-curl-7658-11fc4d

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7658-8e7216

Killing

Stopping container test-curl-7658-8e7216
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-03e614-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-03e614-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused

opendatahub

kubelet

test-curl-7658-11fc4d

Killing

Stopping container test-curl-7658-11fc4d

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-8c852b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-8c852b

openshift-ingress

replicaset-controller

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57

SuccessfulCreate

Created pod: e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

openshift-ingress

multus

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-8c852b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8c852b-openshift-default-8fbd4dc57 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8c852b: serviceaccount "payload-processing-e2e-extmod-a-8c852b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8c852b-75b86db447

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-8c852b-75b86db447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8c852b: serviceaccount "payload-processing-e2e-extmod-a-8c852b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8c852b-75b86db447

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-8c852b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-8c852b-75b86db447 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-8c852b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7

AddedInterface

Add eth0 [10.132.1.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd

AddedInterface

Add eth0 [10.132.1.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-2cc983

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-2cc983

openshift-ingress

replicaset-controller

e2e-shared-b-w4-2cc983-openshift-default-649c558565

SuccessfulCreate

Created pod: e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

openshift-ingress

deployment-controller

e2e-shared-b-w4-2cc983-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-2cc983-openshift-default-649c558565 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-03e614-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-03e614-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7652-bc4f22

Created

Container created

opendatahub

kubelet

test-curl-7652-bc4f22

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7652-bc4f22

AddedInterface

Add eth0 [10.132.1.41/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7652-bc4f22

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-2cc983

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-2cc983

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-2cc983: serviceaccount "payload-processing-e2e-shared-b-w4-2cc983" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-2cc983: serviceaccount "payload-processing-e2e-shared-b-w4-2cc983" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz

AddedInterface

Add eth0 [10.132.1.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh

AddedInterface

Add eth0 [10.132.1.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-1a5f4a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85

SuccessfulCreate

Created pod: e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-1a5f4a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-1a5f4a

openshift-ingress

multus

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes
(x9)

openshift-ingress

deployment-controller

e2e-worker-w1-3c4802-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-3c4802-openshift-default-865cb5887f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-3c4802-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-3c4802-openshift-default-865cb5887f

SuccessfulDelete

Deleted pod: e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-lkshf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-1a5f4a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1a5f4a-77d955759f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1a5f4a: serviceaccount "payload-processing-e2e-extmod-a-1a5f4a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-1a5f4a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-1a5f4a-77d955759f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1a5f4a-77d955759f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-1a5f4a-77d955759f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1a5f4a: serviceaccount "payload-processing-e2e-extmod-a-1a5f4a" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj

AddedInterface

Add eth0 [10.132.1.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs

AddedInterface

Add eth0 [10.132.1.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-2cc983-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-2cc983-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7652-bc4f22

Killing

Stopping container test-curl-7652-bc4f22

openshift-ingress

replicaset-controller

e2e-extmod-a-be6ecc-openshift-default-59846f5749

SuccessfulCreate

Created pod: e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

openshift-ingress

deployment-controller

e2e-extmod-a-be6ecc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-be6ecc-openshift-default-59846f5749 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-be6ecc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-be6ecc

openshift-ingress

multus

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-be6ecc: serviceaccount "payload-processing-e2e-extmod-a-be6ecc" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-be6ecc: serviceaccount "payload-processing-e2e-extmod-a-be6ecc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-be6ecc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99 from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

Unhealthy

Readiness probe failed: Get "http://10.134.0.133:15021/healthz/ready": read tcp 10.134.0.2:57752->10.134.0.133:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

ProbeError

Readiness probe error: Get "http://10.134.0.133:15021/healthz/ready": read tcp 10.134.0.2:57752->10.134.0.133:15021: read: connection reset by peer body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-be6ecc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-be6ecc-75c5d958f5 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4

AddedInterface

Add eth0 [10.132.1.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx

AddedInterface

Add eth0 [10.132.1.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

ProbeError

Startup probe error: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

Unhealthy

Startup probe failed: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-be6ecc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-be6ecc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8c852b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8c852b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-extmod-b-7a134d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-7a134d-openshift-default-559bcb57b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-7a134d-openshift-default-559bcb57b5

SuccessfulCreate

Created pod: e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-2cc983-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-7a134d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-7a134d
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-2cc983-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-autores-5a5534

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5a5534
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1a5f4a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1a5f4a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-autores-5a5534-openshift-default-66cbb544f7

SuccessfulCreate

Created pod: e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

openshift-ingress

multus

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

AddedInterface

Add eth0 [10.132.1.52/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-5a5534-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5a5534-openshift-default-66cbb544f7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-7a134d: serviceaccount "payload-processing-e2e-extmod-b-7a134d" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-7a134d-694b898ffc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-7a134d-694b898ffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-7a134d: serviceaccount "payload-processing-e2e-extmod-b-7a134d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-7a134d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-7a134d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-7a134d-694b898ffc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-7a134d-694b898ffc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4

AddedInterface

Add eth0 [10.132.1.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn

AddedInterface

Add eth0 [10.132.1.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5a5534-7ffd856679

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5a5534-7ffd856679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5a5534: serviceaccount "payload-processing-e2e-autores-5a5534" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5a5534

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5a5534: serviceaccount "payload-processing-e2e-autores-5a5534" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5a5534

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5a5534-7ffd856679 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5a5534-7ffd856679

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5a5534-7ffd856679-24hkw

openshift-ingress

multus

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2

AddedInterface

Add eth0 [10.132.1.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5534-7ffd856679-24hkw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5534-7ffd856679-24hkw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-5a5534-7ffd856679-24hkw

AddedInterface

Add eth0 [10.132.1.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5534-7ffd856679-24hkw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6e0b99

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6e0b99

openshift-ingress

deployment-controller

e2e-extmod-a-6e0b99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6e0b99-openshift-default-849bf65785 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-6e0b99-openshift-default-849bf65785

SuccessfulCreate

Created pod: e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

openshift-ingress

multus

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1a5f4a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7a134d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1a5f4a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7a134d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6e0b99

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6e0b99

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6e0b99-88d6ff86f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6e0b99: serviceaccount "payload-processing-e2e-extmod-a-6e0b99" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6e0b99: serviceaccount "payload-processing-e2e-extmod-a-6e0b99" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db

AddedInterface

Add eth0 [10.132.1.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn

AddedInterface

Add eth0 [10.132.1.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-extmod-b-6b46c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-6b46c3-openshift-default-56b64694fc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-6b46c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-6b46c3

openshift-ingress

replicaset-controller

e2e-extmod-b-6b46c3-openshift-default-56b64694fc

SuccessfulCreate

Created pod: e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

openshift-ingress

multus

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-6b46c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-6b46c3-575b687889 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-6b46c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6b46c3-575b687889

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6b46c3: serviceaccount "payload-processing-e2e-extmod-b-6b46c3" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-6b46c3-575b687889

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-6b46c3-575b687889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-6b46c3: serviceaccount "payload-processing-e2e-extmod-b-6b46c3" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm

AddedInterface

Add eth0 [10.132.1.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5

AddedInterface

Add eth0 [10.132.1.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

Unhealthy

Startup probe failed: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

ProbeError

Startup probe error: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-be6ecc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-be6ecc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-5bb0b1-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-5bb0b1-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

ProbeError

Readiness probe error: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-wvdps

Unhealthy

Readiness probe failed: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-be6ecc-67d458fb99-bgwzx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-be6ecc-75c5d958f5-8lgz4

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

Unhealthy

Startup probe failed: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

ProbeError

Startup probe error: Get "http://10.132.1.52:15021/healthz/ready": dial tcp 10.132.1.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

Unhealthy

Startup probe failed: Get "http://10.132.1.52:15021/healthz/ready": dial tcp 10.132.1.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

ProbeError

Startup probe error: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-5a5534-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-5a5534-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6e0b99-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-6e0b99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6e0b99-openshift-default-849bf65785 from 1 to 3

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

AddedInterface

Add eth0 [10.132.1.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-6e0b99-openshift-default-849bf65785

SuccessfulCreate

Created pod: e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

openshift-ingress

replicaset-controller

e2e-extmod-a-6e0b99-openshift-default-849bf65785

SuccessfulCreate

Created pod: e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-be6ecc-openshift-default-59846f5749-bvpjr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-5a5534-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-5a5534-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

Unhealthy

Startup probe failed: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

Unhealthy

Startup probe failed: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

ProbeError

Startup probe error: Get "http://10.132.1.75:15021/healthz/ready": dial tcp 10.132.1.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

ProbeError

Startup probe error: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

ProbeError

Startup probe error: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

Unhealthy

Startup probe failed: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7a134d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-7a134d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6e0b99-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6e0b99-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-autores-5a5534-7ffd856679-24hkw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5a5534-84b4d9b9d7-2rmz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8c852b-6587d75fd7-c49hd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8c852b-75b86db447-x5vk7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

Started

Container started
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-ef00a4-7655877c99-zprzb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-ef00a4-79d54c497f-f776l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

ProbeError

Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

Unhealthy

Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w1-ef00a4-openshift-default-8d489689c-fgkgp

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6b46c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6b46c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6e0b99-88d6ff86f-4x7db

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6e0b99-58bd4bd48c-j78rn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-5a5534-openshift-default-66cbb544f7-xpfbk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6b46c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-6b46c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1a5f4a-77d955759f-wrsjj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1a5f4a-64b968b555-4bmjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-pgxxd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-42kd6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-6e0b99-openshift-default-849bf65785-8x882

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-extmod-a-0c4786-openshift-default-fdc958bcc

SuccessfulCreate

Created pod: e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-0c4786

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-0c4786

openshift-ingress

deployment-controller

e2e-extmod-a-0c4786-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-0c4786-openshift-default-fdc958bcc from 0 to 1

openshift-ingress

multus

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

AddedInterface

Add eth0 [10.132.1.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-03e614-5f847dd695-kxhq5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-03e614-86546c967-n96mz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-323082-d7cdd9b7c-nrkfx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-323082-c7fb45f99-bcvtx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0c4786-5d5b944779

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-0c4786-5d5b944779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0c4786: serviceaccount "payload-processing-e2e-extmod-a-0c4786" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-0c4786

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-0c4786-5d5b944779 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0c4786-5d5b944779

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-0c4786

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-0c4786-5794759b99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0c4786: serviceaccount "payload-processing-e2e-extmod-a-0c4786" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k

AddedInterface

Add eth0 [10.132.1.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7

AddedInterface

Add eth0 [10.132.1.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-323082-openshift-default-78f46c58c5-nq76r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0c4786-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0c4786-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-8c852b-openshift-default-8fbd4dc57-sclzk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-3c4802-7bd9747b5f-sfrmg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-3c4802-5f6bddd989-bl95r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-03e614-openshift-default-5c57894957-pd2pc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-7a134d-d7bc4dc7f-s2nl4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-7a134d-694b898ffc-ftqdn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-2cc983-6cccb7f975-96blh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-2cc983-6f9746d7dc-5stdz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

Unhealthy

Readiness probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-1a5f4a-openshift-default-f4ffc7f85-mgb5f

ProbeError

Readiness probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-6b46c3-575b687889-fw8l5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-6b46c3-5b688c8bf5-vq8xm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

ProbeError

Readiness probe error: Get "http://10.132.1.83:15021/healthz/ready": read tcp 10.132.0.2:51566->10.132.1.83:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

Unhealthy

Readiness probe failed: Get "http://10.132.1.83:15021/healthz/ready": read tcp 10.132.0.2:51566->10.132.1.83:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

ProbeError

Startup probe error: Get "http://10.132.1.83:15021/healthz/ready": dial tcp 10.132.1.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

Unhealthy

Startup probe failed: Get "http://10.132.1.83:15021/healthz/ready": dial tcp 10.132.1.83:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-7a134d-openshift-default-559bcb57b5-wt56m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-3c4802-openshift-default-865cb5887f-spsrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-2cc983-openshift-default-649c558565-vwjfp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-6b46c3-openshift-default-56b64694fc-8lczm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-9af9e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-9af9e7

openshift-ingress

deployment-controller

e2e-extmod-b-9af9e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-9af9e7-openshift-default-bc67b7949 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-9af9e7-openshift-default-bc67b7949

SuccessfulCreate

Created pod: e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

openshift-ingress

multus

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0c4786-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0c4786-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5e884c-5b47bc5587-l7cng

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5e884c-74b45dd67f-z9qf6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-26743a-75976bb55f-5vl8h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-26743a-fcb59c9c7-s4rnl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-9af9e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9af9e7: serviceaccount "payload-processing-e2e-extmod-b-9af9e7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-9af9e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-9af9e7: serviceaccount "payload-processing-e2e-extmod-b-9af9e7" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

AddedInterface

Add eth0 [10.132.1.97/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-43d592-6cf85b6645-f4dvl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-43d592-54c9b96dcf-6bwjj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-26743a-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-26743a-openshift-default-56b6f9f987

SuccessfulCreate

Created pod: e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-5e884c-openshift-default-5b859fffbf-cgr9x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-26743a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-26743a-openshift-default-56b6f9f987 from 1 to 3

openshift-ingress

replicaset-controller

e2e-worker-w4-26743a-openshift-default-56b6f9f987

SuccessfulCreate

Created pod: e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

openshift-ingress

multus

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

AddedInterface

Add eth0 [10.132.1.98/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

Created

Container created
(x4)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

Unhealthy

Startup probe failed: Get "http://10.132.1.98:15021/healthz/ready": dial tcp 10.132.1.98:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

ProbeError

Startup probe error: Get "http://10.132.1.98:15021/healthz/ready": dial tcp 10.132.1.98:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-qxxcn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-4pq5w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-26743a-openshift-default-56b6f9f987-8t8b4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-43d592-openshift-default-89674766c-zwx9s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5bb0b1-84fcf8f4c9-nrgq5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5bb0b1-6cb99c7fd7-vl47k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-ae7a1f-openshift-default-68b54dc97c-kcxnh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-ae7a1f-fb544d65f-xm9pl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-ae7a1f-76f66786c9-mg2pk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-5bb0b1-openshift-default-7b9f69bf65-849dt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9af9e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-9af9e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-4d14e0-5c95b4c4b7-lrtgh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-4d14e0-8577b8cdc7-tpcg9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-56f3fe-6689c845d7-c2f5w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-56f3fe-78865dc69c-22kpq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-4d14e0-openshift-default-649bbfdc7f-zrdwx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-56f3fe-openshift-default-784cd69b87-xkc7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0c4786-5d5b944779-r8f5k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0c4786-5794759b99-6k4f7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-0c4786-openshift-default-fdc958bcc-4p4qc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-9af9e7-openshift-default-bc67b7949-wncsl

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-9af9e7-7cf8fdb55f-wcff9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-9af9e7-5f578cc4c-9xd7z

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.1.97:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-6fc60c-5f97f5dc85-tmxkl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-6fc60c-595449d895-8cvvp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-6fc60c-openshift-default-66fcd9d47f-4znq2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-c29159-openshift-default-76db59dbc-dw2q5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-c29159-c798bb7d9-w4nlw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-c29159-78bc4bbfb7-7dh9m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9a5623-6fbf554f99-kwmhs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9a5623-597c949cc5-xjcgz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-9a5623-openshift-default-5455ff6b5c-t5zxc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503