Time Namespace Component RelatedObject Reason Message

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-9x4ps to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc to ip-10-0-131-76.ec2.internal

opendatahub

test-curl-11587-c10d24

Scheduled

Successfully assigned opendatahub/test-curl-11587-c10d24 to ip-10-0-131-76.ec2.internal

opendatahub

test-curl-11581-ed6f81

Scheduled

Successfully assigned opendatahub/test-curl-11581-ed6f81 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7 to ip-10-0-131-76.ec2.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-j7nfs

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j7nfs to ip-10-0-131-76.ec2.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-sztv9

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-sztv9 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt to ip-10-0-131-76.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-64c9d5fd44-6wf86 to ip-10-0-138-23.ec2.internal

opendatahub

test-curl-11581-ccb939

Scheduled

Successfully assigned opendatahub/test-curl-11581-ccb939 to ip-10-0-138-23.ec2.internal

opendatahub

test-curl-11581-beec74

Scheduled

Successfully assigned opendatahub/test-curl-11581-beec74 to ip-10-0-138-23.ec2.internal

openshift-ingress

router-default-5bfdf864c-tzv67

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-5bfdf864c-tzv67

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-5bfdf864c-tzv67

Scheduled

Successfully assigned openshift-ingress/router-default-5bfdf864c-tzv67 to ip-10-0-141-251.ec2.internal

opendatahub

test-curl-11581-9ddde6

Scheduled

Successfully assigned opendatahub/test-curl-11581-9ddde6 to ip-10-0-141-251.ec2.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-2vh57

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-2vh57 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm to ip-10-0-138-23.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-64c9d5fd44-pmmwk to ip-10-0-141-251.ec2.internal

opendatahub

test-curl-11581-8a9ac2

Scheduled

Successfully assigned opendatahub/test-curl-11581-8a9ac2 to ip-10-0-141-251.ec2.internal

opendatahub

test-curl-11581-2e9061

Scheduled

Successfully assigned opendatahub/test-curl-11581-2e9061 to ip-10-0-141-251.ec2.internal

opendatahub

test-curl-11575-e07a4a

Scheduled

Successfully assigned opendatahub/test-curl-11575-e07a4a to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz to ip-10-0-131-76.ec2.internal

openshift-jobset-operator

jobset-controller-manager-f445d948b-brn6f

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-f445d948b-brn6f to ip-10-0-138-23.ec2.internal

opendatahub

test-curl-11575-54de04

Scheduled

Successfully assigned opendatahub/test-curl-11575-54de04 to ip-10-0-141-251.ec2.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-64c9d5fd44-wztn7 to ip-10-0-131-76.ec2.internal

opendatahub

odh-model-controller-769875db56-mhfr6

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-mhfr6 to ip-10-0-138-23.ec2.internal

opendatahub

model-serving-api-75bd89fdfc-g5g58

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-g5g58 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp to ip-10-0-138-23.ec2.internal

opendatahub

maas-controller-7bb8f9449b-nnd2b

Scheduled

Successfully assigned opendatahub/maas-controller-7bb8f9449b-nnd2b to ip-10-0-131-76.ec2.internal

kuadrant-system

authorino-56c6c9ddd5-vbmqz

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-vbmqz to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx to ip-10-0-131-76.ec2.internal

kuadrant-system

authorino-57f7f8659f-d56wv

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-d56wv to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs to ip-10-0-131-76.ec2.internal

kuadrant-system

authorino-5949f4fc4c-bpf6c

Scheduled

Successfully assigned kuadrant-system/authorino-5949f4fc4c-bpf6c to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg to ip-10-0-131-76.ec2.internal

kuadrant-system

authorino-5f96c4569b-7p5fs

Scheduled

Successfully assigned kuadrant-system/authorino-5f96c4569b-7p5fs to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv to ip-10-0-138-23.ec2.internal

kuadrant-system

authorino-6889cbd8c4-lmj92

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-lmj92 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5 to ip-10-0-141-251.ec2.internal

kuadrant-system

authorino-6f6944bcdd-l8mr9

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-l8mr9 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt to ip-10-0-138-23.ec2.internal

kuadrant-system

authorino-operator-7b7bb4bc77-7m749

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-7m749 to ip-10-0-141-251.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-85d774877-zkcdx

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-85d774877-zkcdx to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e636da41-openshift-default-99df89b57-62xrg to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm to ip-10-0-131-76.ec2.internal

opendatahub

maas-controller-786557dc8d-qg9mf

Scheduled

Successfully assigned opendatahub/maas-controller-786557dc8d-qg9mf to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2 to ip-10-0-138-23.ec2.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-lnqqz

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-lnqqz to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf to ip-10-0-138-23.ec2.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-b5bdw

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-b5bdw to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz to ip-10-0-141-251.ec2.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-zrh8j

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-zrh8j to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2 to ip-10-0-141-251.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-5z7d8

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-5z7d8 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554 to ip-10-0-131-76.ec2.internal

cert-manager

cert-manager-597b95cb84-scmpv

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-scmpv to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2 to ip-10-0-141-251.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-kz5cc

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-kz5cc to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr to ip-10-0-141-251.ec2.internal

opendatahub

llmisvc-controller-manager-6466c554d8-nsldm

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-nsldm to ip-10-0-141-251.ec2.internal

kuadrant-system

limitador-limitador-74dfcfb894-wmzfj

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-wmzfj to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

Scheduled

Successfully assigned openshift-ingress/e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl to ip-10-0-141-251.ec2.internal

kuadrant-system

limitador-limitador-7c9b87d574-9wwfc

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-9wwfc to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-7b98bb678c-94zmh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-94zmh to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw to ip-10-0-131-76.ec2.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-wgm7f

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-wgm7f to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt to ip-10-0-138-23.ec2.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-vjg48

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-vjg48 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

Scheduled

Successfully assigned openshift-ingress/e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

Scheduled

Successfully assigned openshift-ingress/e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j to ip-10-0-138-23.ec2.internal

opendatahub

kserve-controller-manager-776cc66d47-7q7p5

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-7q7p5 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b to ip-10-0-138-23.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q to ip-10-0-141-251.ec2.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-st46v

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-st46v to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7 to ip-10-0-138-23.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-xpkqq to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-xnnfx to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl to ip-10-0-131-76.ec2.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-5ltm6

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-5ltm6 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj to ip-10-0-138-23.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-xcqb4 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2 to ip-10-0-131-76.ec2.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-wvt6m

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-wvt6m to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-w9qb8 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-sn5mv to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt to ip-10-0-138-23.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-sbxks to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6 to ip-10-0-138-23.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-rhhh8 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f to ip-10-0-138-23.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-qtfcj to ip-10-0-131-76.ec2.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-2gm67

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-2gm67 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx to ip-10-0-141-251.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-pk78c to ip-10-0-141-251.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-kxnqt to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-kp7x7 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-d9b94 to ip-10-0-141-251.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-bc9xz to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-5f78687d5b-ftmv4

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-ftmv4 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-b94h6 to ip-10-0-138-23.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-b2fvc to ip-10-0-141-251.ec2.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47 to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-9ngvj to ip-10-0-138-23.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-7tbjq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-7tbjq to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8 to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-66j8t to ip-10-0-131-76.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-55f85cf5d7-5smp6 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c35d6b-74886576d-96flx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c35d6b-74886576d-96flx to ip-10-0-138-23.ec2.internal

llm

echo-simulator-kserve-64b6f8f96c-l4qzc

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-l4qzc to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8 to ip-10-0-131-76.ec2.internal

openshift-ingress

kube-auth-proxy-68fcc45f6c-twgp9

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68fcc45f6c-twgp9 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-aef61e-79dc689d48-558wv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-aef61e-79dc689d48-558wv to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk to ip-10-0-131-76.ec2.internal

openshift-ingress

kube-auth-proxy-68fcc45f6c-fbxv7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-68fcc45f6c-fbxv7 to ip-10-0-131-76.ec2.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj to ip-10-0-138-23.ec2.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx to ip-10-0-138-23.ec2.internal

opendatahub

ai-gateway-controller-7d85675f98-46f4f

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-46f4f to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4 to ip-10-0-138-23.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-vmxrp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-vmxrp to ip-10-0-141-251.ec2.internal

models-as-a-service

payload-processing-external-model-64b8599cdb-bxjhm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-64b8599cdb-bxjhm to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r to ip-10-0-131-76.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-h89vv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-h89vv to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj to ip-10-0-141-251.ec2.internal

models-as-a-service

payload-processing-external-model-64b8599cdb-z7hls

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-64b8599cdb-z7hls to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn to ip-10-0-138-23.ec2.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-82z8s

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-82z8s to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm to ip-10-0-138-23.ec2.internal

models-as-a-service

payload-processing-external-model-696c89547b-6ftjg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-696c89547b-6ftjg to ip-10-0-138-23.ec2.internal

opendatahub

ai-gateway-controller-6858bfbcf8-h9qws

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6858bfbcf8-h9qws to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4 to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m to ip-10-0-138-23.ec2.internal

models-as-a-service

payload-processing-external-model-6c9884c959-7qlvl

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6c9884c959-7qlvl to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv to ip-10-0-141-251.ec2.internal

models-as-a-service

payload-processing-external-model-7f7cbc76ff-559nv

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7f7cbc76ff-559nv to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984 to ip-10-0-138-23.ec2.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-v9xq8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-v9xq8 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm to ip-10-0-141-251.ec2.internal

models-as-a-service

payload-processing-external-model-869554dfbc-tvkrp

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-869554dfbc-tvkrp to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj to ip-10-0-141-251.ec2.internal

openshift-ingress

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24 to ip-10-0-138-23.ec2.internal

models-as-a-service

payload-processing-external-model-99c554458-p54jm

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-99c554458-p54jm to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4 to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2 to ip-10-0-141-251.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s to ip-10-0-138-23.ec2.internal

models-as-a-service

payload-processing-external-model-d5bdfd759-stjl2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d5bdfd759-stjl2 to ip-10-0-138-23.ec2.internal

openshift-ingress

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt to ip-10-0-141-251.ec2.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-vr2dm

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-vr2dm to ip-10-0-138-23.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w to ip-10-0-141-251.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5bfdf864c from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

replicaset-controller

router-default-5bfdf864c

SuccessfulCreate

Created pod: router-default-5bfdf864c-tzv67

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-5bfdf864c-tzv67

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-5bfdf864c-tzv67

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x3)

openshift-ingress

kubelet

router-default-5bfdf864c-tzv67

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5bfdf864c-tzv67

Created

Container created

openshift-ingress

kubelet

router-default-5bfdf864c-tzv67

Started

Container started

openshift-ingress

kubelet

router-default-5bfdf864c-tzv67

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-5bfdf864c-tzv67

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-v9xq8

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-v9xq8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-v9xq8

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-v9xq8

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-v9xq8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.503s (2.503s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-v9xq8

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-v9xq8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-v9xq8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-d9b94

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-6bd54bbbf9

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-6bd54bbbf9 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55f85cf5d7 from 0 to 1

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.202s (9.202s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.274s (9.274s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-6bd54bbbf9-bt2fx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-64c9d5fd44

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-64c9d5fd44

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-64c9d5fd44-6wf86

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-64c9d5fd44

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-64c9d5fd44-wztn7

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-64c9d5fd44 from 0 to 3

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-vr2dm

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.816s (2.816s including waiting). Image size: 273709574 bytes.
(x8)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.777s (2.777s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.858s (2.858s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Created

Container created
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vr2dm

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Started

Container started

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-vr2dm

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Started

Container started

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-sztv9

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 302ms (302ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-2vh57

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-6wf86

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 287ms (287ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-pmmwk

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Started

Container started

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-64c9d5fd44-wztn7

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 287ms (287ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-64c9d5fd44-wztn7_752ceb07-5d08-4ef6-b704-706b7d5db04c

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-64c9d5fd44-wztn7_752ceb07-5d08-4ef6-b704-706b7d5db04c became leader

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-2vh57

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

install-pcb66

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sztv9

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-sztv9

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2vh57

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vr2dm

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 3.015s (3.015s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vr2dm

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-vr2dm

Started

Container started
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sztv9

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.558s (2.558s including waiting). Image size: 309650901 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-vr2dm_b6f3006d-ca2a-464e-9d68-55d23e385756 became leader

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sztv9

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sztv9

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2vh57

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.549s (3.549s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2vh57

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2vh57

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-scmpv

cert-manager

multus

cert-manager-597b95cb84-scmpv

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-scmpv

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-scmpv

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-scmpv

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-7m749

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7m749

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-7m749

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7m749

Created

Container created

kuadrant-system

authorino-operator-7b7bb4bc77-7m749_e67b2763-8d69-4bac-905c-1cc49c5b25de

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-7m749_e67b2763-8d69-4bac-905c-1cc49c5b25de became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7m749

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.222s (2.222s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-7m749

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-lnqqz

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-lnqqz

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lnqqz

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

dns-operator-controller-manager-8557cbdb84-lnqqz_2f9be3e5-6897-4569-8dc2-9dbee29aef96

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-lnqqz_2f9be3e5-6897-4569-8dc2-9dbee29aef96 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lnqqz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 1.455s (1.455s including waiting). Image size: 190804149 bytes.

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-kz5cc

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-kz5cc

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-kz5cc

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-wgm7f

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-wgm7f

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-wgm7f

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-wgm7f

Created

Container created

kuadrant-system

limitador-operator-controller-manager-5778bb4449-wgm7f_4d33d2f4-3905-4f67-9c85-dfc5f56a814f

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-wgm7f_4d33d2f4-3905-4f67-9c85-dfc5f56a814f became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-kz5cc

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-kz5cc

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-wgm7f

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-wgm7f

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.442s (1.442s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-kz5cc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.65s (3.65s including waiting). Image size: 424244516 bytes.

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-kz5cc_1b6c2a1f-57ec-418c-94f5-f5a1b859792a

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-kz5cc_1b6c2a1f-57ec-418c-94f5-f5a1b859792a became leader

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-zrh8j

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-zrh8j

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-zrh8j

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-85d774877 from 0 to 1

openshift-ingress

multus

kube-auth-proxy-68fcc45f6c-twgp9

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-twgp9

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-68fcc45f6c-fbxv7

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-85d774877

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-85d774877-zkcdx

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-fbxv7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-68fcc45f6c

SuccessfulCreate

Created pod: kube-auth-proxy-68fcc45f6c-fbxv7

openshift-ingress

replicaset-controller

kube-auth-proxy-68fcc45f6c

SuccessfulCreate

Created pod: kube-auth-proxy-68fcc45f6c-twgp9

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-68fcc45f6c from 0 to 2

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-85d774877-zkcdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-85d774877-zkcdx

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-85d774877-zkcdx

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-85d774877-zkcdx

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": tls: failed to verify certificate: x509: certificate signed by unknown authority

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-twgp9

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-fbxv7

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-twgp9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.597s (2.597s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-fbxv7

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-twgp9

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-68fcc45f6c-fbxv7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.301s (2.301s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-zrh8j

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-zrh8j

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.887s (4.887s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-zrh8j

Created

Container created

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-vjg48

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vjg48

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-vjg48

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vjg48

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vjg48

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-vjg48

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.125s (2.125s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-76n8w"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-lzjkq"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-f445d948b from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-f445d948b

SuccessfulCreate

Created pod: jobset-controller-manager-f445d948b-brn6f

openshift-jobset-operator

kubelet

jobset-controller-manager-f445d948b-brn6f

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-f445d948b-brn6f

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-f445d948b-brn6f

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-f445d948b-brn6f

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.393s (2.393s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-f445d948b-brn6f

Started

Container started

openshift-jobset-operator

jobset-controller-manager-f445d948b-brn6f_be3a3c9f-1f8e-4d89-a514-7f4e5bb4934a

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-f445d948b-brn6f_be3a3c9f-1f8e-4d89-a514-7f4e5bb4934a became leader

opendatahub

kserve-module-controller-manager-7566cf5fc8-vjg48_56a2f913-7394-46a4-b780-b562518c2166

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-vjg48_56a2f913-7394-46a4-b780-b562518c2166 became leader

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-h89vv

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-h89vv

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h89vv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h89vv

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h89vv

Started

Container started

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-g5g58

opendatahub

multus

kserve-controller-manager-776cc66d47-7q7p5

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-7q7p5

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h89vv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h89vv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-mhfr6

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-b5bdw

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-b5bdw

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

kubelet

model-serving-api-75bd89fdfc-g5g58

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-v9xq8

Killing

Stopping container discovery

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7q7p5

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

odh-model-controller-769875db56-mhfr6

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-mhfr6

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-v9xq8

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b5bdw

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

model-serving-api-75bd89fdfc-g5g58

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b5bdw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.097s (2.097s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b5bdw

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-g5g58

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-g5g58

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-mhfr6

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7q7p5

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.138s (2.138s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-mhfr6

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-mhfr6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.709s (2.709s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-g5g58

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.221s (2.221s including waiting). Image size: 184925761 bytes.

opendatahub

kserve-controller-manager-776cc66d47-7q7p5_dac4eccd-afb0-4137-804f-5b9312295cc1

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-7q7p5_dac4eccd-afb0-4137-804f-5b9312295cc1 became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b5bdw

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7q7p5

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-7q7p5

Created

Container created

opendatahub

odh-model-controller-769875db56-mhfr6_70a9a4fa-6d9e-4122-a6a4-c37d305c76f7

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-mhfr6_70a9a4fa-6d9e-4122-a6a4-c37d305c76f7 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-b5bdw_39d8e56f-81fa-44e0-b313-6bf9709073ee

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-b5bdw_39d8e56f-81fa-44e0-b313-6bf9709073ee became leader
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-kz5cc

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-5z7d8

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-5z7d8

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-5z7d8

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-5z7d8

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-5z7d8

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-wmzfj

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-5z7d8_cfba52c9-f2d8-4ca8-b6e1-147855be21ed

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-5z7d8_cfba52c9-f2d8-4ca8-b6e1-147855be21ed became leader

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-d56wv

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wmzfj

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-wmzfj

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-9wwfc

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-d56wv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-vbmqz

kuadrant-system

multus

authorino-57f7f8659f-d56wv

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

multus

authorino-56c6c9ddd5-vbmqz

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-vbmqz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

limitador-limitador-7c9b87d574-9wwfc

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-9wwfc

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-9wwfc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 857ms (857ms including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wmzfj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.668s (2.668s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wmzfj

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-9wwfc

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-9wwfc

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-d56wv

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-d56wv

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-d56wv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.338s (2.338s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wmzfj

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-vbmqz

Created

Container created

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-d56wv

kuadrant-system

kubelet

authorino-56c6c9ddd5-vbmqz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.952s (1.952s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-vbmqz

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-d56wv

Killing

Stopping container authorino

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-wmzfj

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-wmzfj

opendatahub

kubelet

maas-controller-786557dc8d-qg9mf

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7bb8f9449b from 0 to 1

opendatahub

multus

maas-controller-786557dc8d-qg9mf

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-786557dc8d

SuccessfulCreate

Created pod: maas-controller-786557dc8d-qg9mf

opendatahub

replicaset-controller

maas-controller-7bb8f9449b

SuccessfulCreate

Created pod: maas-controller-7bb8f9449b-nnd2b

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-786557dc8d from 0 to 1

opendatahub

multus

maas-controller-7bb8f9449b-nnd2b

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-786557dc8d-qg9mf

Started

Container started

opendatahub

kubelet

maas-controller-7bb8f9449b-nnd2b

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.132s (2.132s including waiting). Image size: 200069630 bytes.

opendatahub

kubelet

maas-controller-786557dc8d-qg9mf

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 2.645s (2.645s including waiting). Image size: 200069630 bytes.

opendatahub

kubelet

maas-controller-786557dc8d-qg9mf

Created

Container created

opendatahub

maas-controller-7bb8f9449b-nnd2b_6950bd10-0f9e-4bad-85af-534dbfa39a16

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7bb8f9449b-nnd2b_6950bd10-0f9e-4bad-85af-534dbfa39a16 became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-j7nfs

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-j7nfs

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-j7nfs

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-786557dc8d from 1 to 0

opendatahub

kubelet

maas-controller-786557dc8d-qg9mf

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-786557dc8d

SuccessfulDelete

Deleted pod: maas-controller-786557dc8d-qg9mf

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-j7nfs

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-j7nfs

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-j7nfs

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 16.096s (16.096s including waiting). Image size: 1089502687 bytes.

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-l8mr9

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-lmj92

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-l8mr9

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-5f96c4569b

SuccessfulCreate

Created pod: authorino-5f96c4569b-7p5fs

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-5f96c4569b from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

kubelet

authorino-6889cbd8c4-lmj92

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-lmj92

kuadrant-system

multus

authorino-6889cbd8c4-lmj92

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5f96c4569b-7p5fs

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-5f96c4569b-7p5fs

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

authorino-6889cbd8c4-lmj92

Created

Container created

kuadrant-system

kubelet

authorino-5f96c4569b-7p5fs

Started

Container started

kuadrant-system

kubelet

authorino-5f96c4569b-7p5fs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 427ms (427ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-lmj92

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 624ms (624ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-lmj92

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6889cbd8c4-lmj92

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Created

Container created

kuadrant-system

kubelet

authorino-5f96c4569b-7p5fs

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Started

Container started

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-nsldm

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-vbmqz

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

kuadrant-system

kubelet

authorino-56c6c9ddd5-vbmqz

Killing

Stopping container authorino

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-nsldm

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-6466c554d8-nsldm

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-nsldm

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-nsldm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 412ms (412ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-nsldm

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-66j8t

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55f85cf5d7 from 1 to 4

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-b94h6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.585s (2.585s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 2.557s (2.557s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.17s (4.17s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

Started

Container started
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-b5bdw

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b5bdw

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

multus

ai-gateway-controller-7d85675f98-46f4f

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-46f4f

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-46f4f

opendatahub

kubelet

ai-gateway-controller-7d85675f98-46f4f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.476s (1.476s including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-46f4f

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-46f4f

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-sbxks

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

opendatahub

ai-gateway-controller-7d85675f98-46f4f_6be7d086-46f6-44bb-b0dc-113beababada

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-46f4f_6be7d086-46f6-44bb-b0dc-113beababada became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55f85cf5d7 from 4 to 8

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-ftmv4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-94zmh

openshift-ingress

multus

payload-processing-5f78687d5b-ftmv4

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-ftmv4

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-94zmh

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-94zmh

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-ftmv4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-94zmh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-94zmh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.041s (3.041s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-ftmv4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.208s (3.208s including waiting). Image size: 125317101 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-94zmh

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-ftmv4

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6858bfbcf8 from 0 to 1

opendatahub

multus

ai-gateway-controller-6858bfbcf8-h9qws

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-6858bfbcf8

SuccessfulCreate

Created pod: ai-gateway-controller-6858bfbcf8-h9qws

opendatahub

kubelet

ai-gateway-controller-6858bfbcf8-h9qws

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 343ms (343ms including waiting). Image size: 183888297 bytes.

opendatahub

kubelet

ai-gateway-controller-6858bfbcf8-h9qws

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6858bfbcf8-h9qws

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6858bfbcf8-h9qws

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

llmisvc-controller-manager-6466c554d8-nsldm_699a7852-fbbd-4c76-84ee-6db8cd7b5664

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-nsldm_699a7852-fbbd-4c76-84ee-6db8cd7b5664 became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-46f4f

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-46f4f

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-st46v

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-st46v

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-st46v

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-st46v

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-st46v

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.59s (1.59s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-st46v

Started

Container started

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-5ltm6

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5ltm6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-5ltm6

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5ltm6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 198ms (198ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5ltm6

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-5ltm6

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-wvt6m

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

opendatahub

ai-gateway-controller-6858bfbcf8-h9qws_f1c05d4e-a225-4b4c-8bb7-f37f4373e9fa

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6858bfbcf8-h9qws_f1c05d4e-a225-4b4c-8bb7-f37f4373e9fa became leader

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-wvt6m

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-wvt6m

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-wvt6m

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-wvt6m

Created

Container created

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-wvt6m

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.061s (1.061s including waiting). Image size: 98346788 bytes.

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-2gm67

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-2gm67

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-2gm67

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-2gm67

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 788ms (788ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-2gm67

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-2gm67

Created

Container created

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8gvmqg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 208ms (208ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-l4qzc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-l4qzc

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-l4qzc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-l4qzc

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-l4qzc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.45s (1.45s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-l4qzc

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 184ms (184ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-nncf9

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 200ms (200ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

kuadrant-system

replicaset-controller

authorino-5949f4fc4c

SuccessfulCreate

Created pod: authorino-5949f4fc4c-bpf6c

kuadrant-system

multus

authorino-5949f4fc4c-bpf6c

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5949f4fc4c-bpf6c

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5949f4fc4c-bpf6c

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 655ms (655ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5949f4fc4c-bpf6c

Created

Container created

kuadrant-system

kubelet

authorino-5949f4fc4c-bpf6c

Started

Container started

kuadrant-system

kubelet

authorino-5f96c4569b-7p5fs

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-5f96c4569b

SuccessfulDelete

Deleted pod: authorino-5f96c4569b-7p5fs
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-5f96c4569b from 1 to 0

openshift-ingress

deployment-controller

e2e-ait-80143318-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-80143318-openshift-default-8bd7b54cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-80143318-openshift-default-8bd7b54cc

SuccessfulCreate

Created pod: e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

openshift-ingress

gateway_labeler_controller

e2e-ait-1c85bd66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1c85bd66

openshift-ingress

gateway_labeler_controller

e2e-ait-80143318

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-80143318

openshift-ingress

gateway_labeler_controller

e2e-migrate-307283d2-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-307283d2-gw

openshift-ingress

deployment-controller

e2e-ait-1c85bd66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1c85bd66-openshift-default-56c4c985d7 from 0 to 1

openshift-ingress

multus

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-307283d2-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5

SuccessfulCreate

Created pod: e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

openshift-ingress

replicaset-controller

e2e-ait-1c85bd66-openshift-default-56c4c985d7

SuccessfulCreate

Created pod: e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

openshift-ingress

multus

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-e636da41-openshift-default-99df89b57

SuccessfulCreate

Created pod: e2e-ait-e636da41-openshift-default-99df89b57-62xrg

openshift-ingress

deployment-controller

e2e-ait-e636da41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e636da41-openshift-default-99df89b57 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-e636da41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e636da41

openshift-ingress

multus

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-307283d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-307283d2-88bc6f9d6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-307283d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-307283d2-76cb675ff5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-307283d2-88bc6f9d6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-307283d2-88bc6f9d6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-307283d2-88bc6f9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-307283d2: serviceaccount "payload-processing-e2e-migrate-307283d2" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-307283d2: serviceaccount "payload-processing-e2e-migrate-307283d2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-80143318-7ccb5f4d78

FailedCreate

Error creating: pods "payload-processing-e2e-ait-80143318-7ccb5f4d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-80143318: serviceaccount "payload-processing-e2e-ait-80143318" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-80143318

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-80143318-7ccb5f4d78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-80143318-7d5b964bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-80143318-7d5b964bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-80143318-7d5b964bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-80143318: serviceaccount "payload-processing-e2e-ait-80143318" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-80143318-7ccb5f4d78

SuccessfulCreate

Created pod: payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-80143318

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-80143318-7d5b964bc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1c85bd66: serviceaccount "payload-processing-e2e-ait-1c85bd66" not found

openshift-ingress

gateway_labeler_controller

e2e-derive-dfd96f0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-dfd96f0e
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1c85bd66: serviceaccount "payload-processing-e2e-ait-1c85bd66" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1c85bd66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1c85bd66-76dcc7d9d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1c85bd66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e636da41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e636da41-77c8b8545f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e636da41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e636da41-7f85998d6 from 0 to 1

openshift-ingress

deployment-controller

e2e-derive-dfd96f0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-dfd96f0e-openshift-default-6d865cbfdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf

SuccessfulCreate

Created pod: e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

openshift-ingress

multus

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e636da41-7f85998d6

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e636da41-77c8b8545f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e636da41-77c8b8545f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e636da41: serviceaccount "payload-processing-e2e-ait-e636da41" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e636da41-7f85998d6

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e636da41-7f85998d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e636da41: serviceaccount "payload-processing-e2e-ait-e636da41" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e636da41-77c8b8545f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

openshift-ingress

multus

payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.718s (2.718s including waiting). Image size: 125317101 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2

openshift-ingress

deployment-controller

payload-processing-e2e-derive-dfd96f0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-dfd96f0e-7c56966f44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-dfd96f0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-dfd96f0e-56687895f5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-dfd96f0e: serviceaccount "payload-processing-e2e-derive-dfd96f0e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-dfd96f0e-7c56966f44

FailedCreate

Error creating: pods "payload-processing-e2e-derive-dfd96f0e-7c56966f44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-dfd96f0e: serviceaccount "payload-processing-e2e-derive-dfd96f0e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-dfd96f0e-7c56966f44

SuccessfulCreate

Created pod: payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27

openshift-ingress

multus

payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-1c85bd66-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-1c85bd66-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Started

Container started

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Unhealthy

Readiness probe failed: Get "http://10.133.0.36:15021/healthz/ready": read tcp 10.133.0.2:37956->10.133.0.36:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

ProbeError

Readiness probe error: Get "http://10.133.0.36:15021/healthz/ready": read tcp 10.133.0.2:37956->10.133.0.36:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-307283d2-76cb675ff5-hqzw6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-307283d2-88bc6f9d6-jtqk6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-1c85bd66-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-1c85bd66-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-80143318-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-80143318-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-307283d2-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-307283d2-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e636da41-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e636da41-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c85bd66-55bcd769cf-q25kb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1c85bd66-76dcc7d9d4-scct7

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-80143318-7ccb5f4d78-bsb8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-80143318-7d5b964bc9-jds2p

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-6a7148

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-6a7148

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 0 to 1

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-307283d2-gw-openshift-default-5fb6c9f6b5-cccr5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e636da41-77c8b8545f-c7wp8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e636da41-7f85998d6-m5kxf

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

Created

Container created

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-512ec5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-512ec5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-6a7148-7b89464846

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-6a7148-7b89464846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-6a7148: serviceaccount "payload-processing-e2e-worker-w3-6a7148" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-6a7148

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-6a7148-7b89464846 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-6a7148: serviceaccount "payload-processing-e2e-worker-w3-6a7148" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-6a7148

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c from 0 to 1

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-80143318-openshift-default-8bd7b54cc-xnnfn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-80143318-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-6a7148-7b89464846

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-80143318-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-47fd99

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-47fd99

openshift-ingress

kubelet

payload-processing-e2e-derive-dfd96f0e-7c56966f44-6gc27

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-dfd96f0e-56687895f5-49tv2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7

Created

Container created

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-1c85bd66-openshift-default-56c4c985d7-gklqv

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f920f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f920f7

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-512ec5: serviceaccount "payload-processing-e2e-worker-w4-512ec5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-512ec5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-512ec5: serviceaccount "payload-processing-e2e-worker-w4-512ec5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-512ec5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-47fd99

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-47fd99-8688dd8dd8 from 0 to 1

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-e636da41-openshift-default-99df89b57-62xrg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-47fd99: serviceaccount "payload-processing-e2e-worker-w2-47fd99" not found

openshift-ingress

multus

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-47fd99

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-47fd99: serviceaccount "payload-processing-e2e-worker-w2-47fd99" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-dfd96f0e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-dfd96f0e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f920f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

openshift-ingress

kubelet

e2e-derive-dfd96f0e-openshift-default-6d865cbfdf-mjw6h

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f920f7-6f98685466

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f920f7-6f98685466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f920f7: serviceaccount "payload-processing-e2e-worker-w0-f920f7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f920f7-6f98685466

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f920f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f920f7-6f98685466 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f920f7: serviceaccount "payload-processing-e2e-worker-w0-f920f7" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 0 to 1

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-c1b1e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-c1b1e8

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-c1b1e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-c1b1e8: serviceaccount "payload-processing-e2e-worker-w1-c1b1e8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-c1b1e8: serviceaccount "payload-processing-e2e-worker-w1-c1b1e8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-c1b1e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

Started

Container started

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 1 to 2

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 1 to 2

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 2 to 3

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 3 to 4

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Started

Container started

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 1 to 3

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 3 to 5

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 4 to 5

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-sbxks

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-66j8t

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-66j8t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

Started

Container started

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sbxks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 5 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 7 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulCreate

Created pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

Created

Container created

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

Started

Container started

openshift-ingress

multus

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 2 to 3

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 3 to 5

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Unhealthy

Liveness probe failed: Get "https://10.134.0.46:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 5 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

Created

Container created

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Unhealthy

Readiness probe failed: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

ProbeError

Readiness probe error: Get "http://10.134.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

ProbeError

Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Unhealthy

Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 5 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

Created

Container created

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-060f41f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-060f41f2

openshift-ingress

deployment-controller

e2e-mt-060f41f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-060f41f2-openshift-default-5f86797c8f from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-060f41f2-openshift-default-5f86797c8f

SuccessfulCreate

Created pod: e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

openshift-ingress

multus

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-060f41f2-85b6c7b85d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-060f41f2: serviceaccount "payload-processing-e2e-mt-060f41f2" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-060f41f2-85b6c7b85d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-060f41f2-85b6c7b85d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-060f41f2: serviceaccount "payload-processing-e2e-mt-060f41f2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-060f41f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-060f41f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-060f41f2-85b6c7b85d from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-2vh57

Unhealthy

Readiness probe failed: Get "http://10.133.0.21:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

Unhealthy

Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-55f85cf5d7-pk78c
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-55f85cf5d7 from 8 to 10

openshift-ingress

multus

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-5649cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5649cd

openshift-ingress

deployment-controller

e2e-api-a-5649cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5649cd-openshift-default-5d487d7975 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-5649cd-openshift-default-5d487d7975

SuccessfulCreate

Created pod: e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 3 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5649cd-55985f67d8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5649cd-7557d8867f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5649cd-7557d8867f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5649cd: serviceaccount "payload-processing-e2e-api-a-5649cd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5649cd-7557d8867f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5649cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5649cd-7557d8867f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5649cd-55985f67d8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5649cd-55985f67d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5649cd: serviceaccount "payload-processing-e2e-api-a-5649cd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5649cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5649cd-55985f67d8 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-vmxrp

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

Started

Container started
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

Unhealthy

Startup probe failed: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

Started

Container started
(x11)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

ProbeError

Startup probe error: Get "http://10.134.0.98:15021/healthz/ready": dial tcp 10.134.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vmxrp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-vmxrp

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vmxrp

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vmxrp

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-vmxrp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.573s (5.573s including waiting). Image size: 185476477 bytes.
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-060f41f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-060f41f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 9 to 10

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

Started

Container started

openshift-ingress

multus

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-7566f5-openshift-default-65db4b858f

SuccessfulCreate

Created pod: e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

openshift-ingress

deployment-controller

e2e-api-b-7566f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7566f5-openshift-default-65db4b858f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-b-7566f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7566f5

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7566f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7566f5-bdbbcf4bb from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7566f5-bdbbcf4bb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7566f5-bdbbcf4bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7566f5: serviceaccount "payload-processing-e2e-api-b-7566f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7566f5-bdbbcf4bb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7566f5: serviceaccount "payload-processing-e2e-api-b-7566f5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7566f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7566f5-7fb946d9f from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Unhealthy

Readiness probe failed: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

ProbeError

Readiness probe error: Get "http://10.133.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-82299a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-82299a

openshift-ingress

deployment-controller

e2e-api-a-82299a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-82299a-openshift-default-67884c4f67 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-060f41f2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-a-82299a-openshift-default-67884c4f67

SuccessfulCreate

Created pod: e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-060f41f2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Started

Container started

openshift-ingress

multus

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-82299a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-82299a-765c7fdfd4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-82299a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-82299a-6944cdb7cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-82299a-765c7fdfd4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-82299a-765c7fdfd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-82299a: serviceaccount "payload-processing-e2e-api-a-82299a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-82299a: serviceaccount "payload-processing-e2e-api-a-82299a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-82299a-765c7fdfd4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

openshift-ingress

multus

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-060f41f2-openshift-default-5f86797c8f

SuccessfulCreate

Created pod: e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

openshift-ingress

deployment-controller

e2e-mt-060f41f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-060f41f2-openshift-default-5f86797c8f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-060f41f2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 5 to 9

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

Started

Container started

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

Started

Container started

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

Started

Container started

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

Unhealthy

Startup probe failed: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

ProbeError

Startup probe error: Get "http://10.134.0.107:15021/healthz/ready": dial tcp 10.134.0.107:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

ProbeError

Startup probe error: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

Unhealthy

Startup probe failed: Get "http://10.132.0.112:15021/healthz/ready": dial tcp 10.132.0.112:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5649cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-5649cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-ebc6bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ebc6bb-openshift-default-84d66c85b7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-ebc6bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ebc6bb

openshift-ingress

replicaset-controller

e2e-api-b-ebc6bb-openshift-default-84d66c85b7

SuccessfulCreate

Created pod: e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

openshift-ingress

multus

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

opendatahub

multus

test-curl-11581-8a9ac2

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11581-8a9ac2

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x5)

openshift-ingress

kubelet

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-5649cd-55985f67d8-6kckr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5649cd-7557d8867f-r97mt

Killing

Stopping container payload-pre-processing

opendatahub

kubelet

test-curl-11581-8a9ac2

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.731s (2.731s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11581-8a9ac2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused

opendatahub

kubelet

test-curl-11581-8a9ac2

Created

Container created
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ebc6bb-768fc47bb4

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ebc6bb-768fc47bb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ebc6bb: serviceaccount "payload-processing-e2e-api-b-ebc6bb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ebc6bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ebc6bb-768fc47bb4

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ebc6bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ebc6bb-768fc47bb4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ebc6bb: serviceaccount "payload-processing-e2e-api-b-ebc6bb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94

Created

Container created

opendatahub

kubelet

test-curl-11581-8a9ac2

Killing

Stopping container test-curl-11581-8a9ac2
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-82299a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-82299a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7566f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7566f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-82299a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-82299a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-5649cd-openshift-default-5d487d7975-ssfwp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-c35d6b-openshift-default-6865944b67

SuccessfulCreate

Created pod: e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

openshift-ingress

gateway_labeler_controller

e2e-api-a-c35d6b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c35d6b

openshift-ingress

deployment-controller

e2e-api-a-c35d6b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c35d6b-openshift-default-6865944b67 from 0 to 1

openshift-ingress

multus

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-mz52m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-tmq4g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-api-b-7566f5-bdbbcf4bb-795v8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7566f5-7fb946d9f-5h2ll

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c35d6b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c35d6b-74886576d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c35d6b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c35d6b-6998f454b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c35d6b-74886576d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c35d6b-74886576d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c35d6b: serviceaccount "payload-processing-e2e-api-a-c35d6b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c35d6b: serviceaccount "payload-processing-e2e-api-a-c35d6b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c35d6b-74886576d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c35d6b-74886576d-96flx

openshift-ingress

kubelet

payload-processing-e2e-api-a-c35d6b-74886576d-96flx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-c35d6b-74886576d-96flx

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-c35d6b-74886576d-96flx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-c35d6b-74886576d-96flx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

Unhealthy

Readiness probe failed: Get "http://10.132.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

ProbeError

Readiness probe error: Get "http://10.132.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ebc6bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ebc6bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-060f41f2-85b6c7b85d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-060f41f2-85b6c7b85d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-060f41f2: serviceaccount "payload-processing-e2e-mt-060f41f2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-060f41f2: serviceaccount "payload-processing-e2e-mt-060f41f2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-060f41f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-060f41f2-85b6c7b85d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-060f41f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-060f41f2-85b6c7b85d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw

openshift-ingress

kubelet

payload-processing-e2e-api-a-82299a-765c7fdfd4-kzpr8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.106:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-82299a-6944cdb7cf-zjdcb

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.105:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ebc6bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-ebc6bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-b-8f2898

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-8f2898

openshift-ingress

deployment-controller

e2e-api-b-8f2898-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-8f2898-openshift-default-64d4dc6f85 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-8f2898-openshift-default-64d4dc6f85

SuccessfulCreate

Created pod: e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

openshift-ingress

multus

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-7566f5-openshift-default-65db4b858f-6c9q9

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8f2898-d5b87fd6b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-8f2898-d5b87fd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8f2898: serviceaccount "payload-processing-e2e-api-b-8f2898" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8f2898-d5b87fd6b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-8f2898

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8f2898: serviceaccount "payload-processing-e2e-api-b-8f2898" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-8f2898

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-8f2898-d5b87fd6b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4

Started

Container started

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

ProbeError

Readiness probe error: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg

Created

Container created

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Unhealthy

Readiness probe failed: Get "http://10.134.0.111:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4

Created

Container created

opendatahub

kubelet

test-curl-11581-ed6f81

Created

Container created

opendatahub

multus

test-curl-11581-ed6f81

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11581-ed6f81

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11581-ed6f81

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Started

Container started

opendatahub

kubelet

test-curl-11581-ed6f81

Killing

Stopping container test-curl-11581-ed6f81
(x2)

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Created

Container created

openshift-ingress

kubelet

e2e-api-a-82299a-openshift-default-67884c4f67-nlnl9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

ProbeError

Startup probe error: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Unhealthy

Startup probe failed: Get "http://10.134.0.111:15021/healthz/ready": dial tcp 10.134.0.111:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-060f41f2-7d56d9b55f-52rtf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-060f41f2-85b6c7b85d-j6gbw

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-060f41f2-openshift-default-5f86797c8f

SuccessfulCreate

Created pod: e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

openshift-ingress

multus

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-060f41f2-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-060f41f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-060f41f2-openshift-default-5f86797c8f from 2 to 3

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

Created

Container created

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-ebc6bb-768fc47bb4-x2rdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ebc6bb-5445fd6f99-zwd94

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

ProbeError

Startup probe error: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

Unhealthy

Startup probe failed: Get "http://10.132.0.125:15021/healthz/ready": dial tcp 10.132.0.125:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c35d6b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c35d6b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

ComponentUnhealthy

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lnqqz

Pulled

Container image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" already present on machine and can be accessed by the pod
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lnqqz

Started

Container started
(x2)

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-lnqqz

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-7bb8f9449b-nnd2b

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

NeedsReinstall

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub

kubelet

maas-controller-7bb8f9449b-nnd2b

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:cdee9d2dbe1dd7d41085ef84a6c161da9a59aea946409daa8decfd915e6f47cd" in 409ms (409ms including waiting). Image size: 200069630 bytes.
(x2)

opendatahub

kubelet

maas-controller-7bb8f9449b-nnd2b

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-7bb8f9449b-nnd2b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8f2898-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8f2898-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x2)

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

dns-operator-controller-manager-8557cbdb84-lnqqz_93442908-7aa6-425a-9d94-52e081311b08

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-lnqqz_93442908-7aa6-425a-9d94-52e081311b08 became leader

opendatahub

maas-controller-7bb8f9449b-nnd2b_4f3a39f8-b84c-4154-95af-1a020010057b

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7bb8f9449b-nnd2b_4f3a39f8-b84c-4154-95af-1a020010057b became leader

openshift-ingress

kubelet

payload-processing-e2e-api-a-c35d6b-74886576d-96flx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c35d6b-6998f454b7-th9kw

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8f2898-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-8f2898-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-ebc6bb-openshift-default-84d66c85b7-ssbvj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-hvbd5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-922643

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-922643

openshift-ingress

deployment-controller

e2e-api-a-922643-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-922643-openshift-default-9547f9f9c from 0 to 1

openshift-ingress

multus

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-922643-openshift-default-9547f9f9c

SuccessfulCreate

Created pod: e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-2wvhr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7e2db2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7e2db2

openshift-ingress

deployment-controller

e2e-ipp-a-7e2db2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7e2db2-openshift-default-547d4f89dc from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc

SuccessfulCreate

Created pod: e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-060f41f2-openshift-default-5f86797c8f-7vcrc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-922643

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-922643-57d7dd5775 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-922643

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-922643-564f9bdf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-922643-57d7dd5775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-922643-564f9bdf4

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-922643-57d7dd5775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-922643-57d7dd5775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-922643: serviceaccount "payload-processing-e2e-api-a-922643" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-922643-564f9bdf4

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-922643-564f9bdf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-922643: serviceaccount "payload-processing-e2e-api-a-922643" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-876549-openshift-default-749d786c77

SuccessfulCreate

Created pod: e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-876549

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-876549

openshift-ingress

kubelet

payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-a-876549-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-876549-openshift-default-749d786c77 from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-a-951ad1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-951ad1-openshift-default-74bd9dcf45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45

SuccessfulCreate

Created pod: e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-951ad1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-951ad1

openshift-ingress

multus

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-951ad1: serviceaccount "payload-processing-e2e-ipp-a-951ad1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-951ad1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-951ad1: serviceaccount "payload-processing-e2e-ipp-a-951ad1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-951ad1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-951ad1-5b77ff48d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-api-b-aef61e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-aef61e

openshift-ingress

deployment-controller

e2e-api-b-aef61e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-aef61e-openshift-default-554c4fbd5f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-aef61e-openshift-default-554c4fbd5f

SuccessfulCreate

Created pod: e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

openshift-ingress

multus

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-aef61e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-aef61e-79dc689d48 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-aef61e-79dc689d48

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-aef61e-79dc689d48-558wv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-aef61e: serviceaccount "payload-processing-e2e-api-b-aef61e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-aef61e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-aef61e-74d8ddf95 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-aef61e-79dc689d48

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-aef61e-79dc689d48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-aef61e: serviceaccount "payload-processing-e2e-api-b-aef61e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f2898-c59b9c6f5-lx6d4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922643-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f2898-d5b87fd6b-2gqwg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922643-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-aef61e-79dc689d48-558wv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-aef61e-79dc689d48-558wv

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-aef61e-79dc689d48-558wv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-aef61e-79dc689d48-558wv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-t5xwn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-s6qc6

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-48bsw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-w897z

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 10 to 6

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-c35d6b-openshift-default-6865944b67-m8jvl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-876549-7c67b6f94b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-876549-7c67b6f94b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-876549: serviceaccount "payload-processing-e2e-ipp-a-876549" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-876549-7c67b6f94b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8e3112

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8e3112

openshift-ingress

deployment-controller

e2e-ipp-a-8e3112-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8e3112-openshift-default-6cf6458b87 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-8e3112-openshift-default-6cf6458b87

SuccessfulCreate

Created pod: e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-876549: serviceaccount "payload-processing-e2e-ipp-a-876549" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-876549

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-876549

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-876549-7c67b6f94b from 0 to 1

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-8f2898-openshift-default-64d4dc6f85-gg25x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7e2db2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7e2db2-6dff647484 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7e2db2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e2db2-6dff647484

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7e2db2-6dff647484-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e2db2: serviceaccount "payload-processing-e2e-ipp-a-7e2db2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e2db2-6dff647484

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e2db2: serviceaccount "payload-processing-e2e-ipp-a-7e2db2" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8e3112: serviceaccount "payload-processing-e2e-ipp-a-8e3112" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8e3112

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8e3112-f8589c488 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8e3112-f8589c488

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8e3112

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8e3112-f8589c488

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8e3112-f8589c488-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8e3112: serviceaccount "payload-processing-e2e-ipp-a-8e3112" not found

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 10 to 7

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rx4tf

openshift-ingress

multus

payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-hbpxv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-pzdcj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 10 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-2mzqj

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-lxtft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vs96m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-svfjk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-559c7ccf8c-mhtlb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-5b77ff48d6-bxcgx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922643-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-82z8s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-82z8s

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-922643-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-82z8s

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-82z8s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.426s (3.426s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-82z8s

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-82z8s

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-82z8s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-82z8s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-951ad1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-951ad1-7d788c86d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-951ad1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-951ad1: serviceaccount "payload-processing-e2e-ipp-a-951ad1" not found
(x8)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-951ad1-7d788c86d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-951ad1-7d788c86d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-951ad1: serviceaccount "payload-processing-e2e-ipp-a-951ad1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-951ad1-7d788c86d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-951ad1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-951ad1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.392s (2.392s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.588s (2.588s including waiting). Image size: 166612641 bytes.

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-c8nxg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-ldqkt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-fnpm7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 10 to 6

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-h7m6n

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-aef61e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-aef61e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-69cc8bd9c5-zhnhx

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-7c67b6f94b-n2qg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-922643-564f9bdf4-c9v9g

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-431bf6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-431bf6

openshift-ingress

deployment-controller

e2e-ipp-b-431bf6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-431bf6-openshift-default-7b68d97df from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-431bf6-openshift-default-7b68d97df

SuccessfulCreate

Created pod: e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-876549-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-876549-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-922643-57d7dd5775-cv2tm

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-5d65fc55f-6vvfn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-6dff647484-mkkxz

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

Unhealthy

Startup probe failed: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

ProbeError

Startup probe error: Get "http://10.134.0.117:15021/healthz/ready": dial tcp 10.134.0.117:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-431bf6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-431bf6-698c4475f4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-431bf6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-431bf6-698c4475f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-431bf6-698c4475f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-431bf6-698c4475f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-431bf6: serviceaccount "payload-processing-e2e-ipp-b-431bf6" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-431bf6: serviceaccount "payload-processing-e2e-ipp-b-431bf6" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-951ad1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-951ad1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-266486

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-266486

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-b-266486-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-266486-openshift-default-7b475d5bcc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-266486-openshift-default-7b475d5bcc

SuccessfulCreate

Created pod: e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

openshift-ingress

multus

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-7b956b5bf5-q56rh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-f8589c488-qnl47

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-266486

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-266486: serviceaccount "payload-processing-e2e-ipp-b-266486" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-266486-796679cbbb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-266486-796679cbbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-266486: serviceaccount "payload-processing-e2e-ipp-b-266486" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-266486

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-266486-796679cbbb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-266486-796679cbbb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

Unhealthy

Readiness probe failed: Get "http://10.134.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

ProbeError

Readiness probe error: Get "http://10.134.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-876549

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-876549-9b675db4d from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-876549: serviceaccount "payload-processing-e2e-ipp-a-876549" not found

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 9 to 6

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-876549-9b675db4d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-876549-9b675db4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-876549: serviceaccount "payload-processing-e2e-ipp-a-876549" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-876549-9b675db4d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-876549

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-876549-6858f64d9f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-vcvxs

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-nmpml

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4vzpf

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e2db2: serviceaccount "payload-processing-e2e-ipp-a-7e2db2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7e2db2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7e2db2: serviceaccount "payload-processing-e2e-ipp-a-7e2db2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7e2db2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7e2db2-65bd664f7d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.817s (2.817s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.759s (2.759s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 464ms (464ms including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.058s (1.058s including waiting). Image size: 166612641 bytes.
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7e2db2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7e2db2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

Unhealthy

Startup probe failed: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

ProbeError

Startup probe error: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8e3112-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8e3112-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-876549-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-876549-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8e3112-79d664bddb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8e3112-79d664bddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8e3112: serviceaccount "payload-processing-e2e-ipp-a-8e3112" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8e3112

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8e3112-79d664bddb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8e3112-79d664bddb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8e3112

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8e3112: serviceaccount "payload-processing-e2e-ipp-a-8e3112" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-096834

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-096834

openshift-ingress

deployment-controller

e2e-ipp-b-096834-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-096834-openshift-default-7d7f756545 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-096834-openshift-default-7d7f756545

SuccessfulCreate

Created pod: e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

openshift-ingress

multus

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-aef61e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-aef61e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8e3112-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-8e3112-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-a-922643-openshift-default-9547f9f9c-2qbwz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-096834

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096834-68dccf59d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-096834-68dccf59d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096834: serviceaccount "payload-processing-e2e-ipp-b-096834" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-096834

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-096834-68dccf59d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096834-68dccf59d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096834: serviceaccount "payload-processing-e2e-ipp-b-096834" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5c57af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5c57af

openshift-ingress

deployment-controller

e2e-ipp-b-5c57af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5c57af-openshift-default-7c49498d95 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-5c57af-openshift-default-7c49498d95

SuccessfulCreate

Created pod: e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8

Started

Container started

openshift-ingress

multus

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Unhealthy

Readiness probe failed: Get "http://10.133.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

ProbeError

Readiness probe error: Get "http://10.133.0.95:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c57af: serviceaccount "payload-processing-e2e-ipp-b-5c57af" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5c57af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5c57af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c57af: serviceaccount "payload-processing-e2e-ipp-b-5c57af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-aef61e-79dc689d48-558wv

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-aef61e-74d8ddf95-lgjnt

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-431bf6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-431bf6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-555466f5f5-4dbmv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-698c4475f4-w2q24

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-796679cbbb-smh2z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-54bb7dc7f9-pt8bn

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-431bf6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-431bf6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5c57af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5c57af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-431bf6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-431bf6: serviceaccount "payload-processing-e2e-ipp-b-431bf6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-431bf6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-431bf6-6f845d7bb8 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-431bf6: serviceaccount "payload-processing-e2e-ipp-b-431bf6" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-266486-fb74bbcbd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-266486-fb74bbcbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-266486: serviceaccount "payload-processing-e2e-ipp-b-266486" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-266486-994d58dff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-266486-994d58dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-266486: serviceaccount "payload-processing-e2e-ipp-b-266486" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-266486

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-266486-fb74bbcbd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-266486

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-266486-994d58dff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-266486-994d58dff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-266486-fb74bbcbd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-aef61e-openshift-default-554c4fbd5f-t6k2v

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-266486-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-266486-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-ipp-a-7eee3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7eee3b-openshift-default-96456c9fc from 0 to 1

openshift-ingress

multus

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-7eee3b-openshift-default-96456c9fc

SuccessfulCreate

Created pod: e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7eee3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7eee3b

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7eee3b-6648d989f8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7eee3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7eee3b: serviceaccount "payload-processing-e2e-ipp-a-7eee3b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7eee3b-6648d989f8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7eee3b-6648d989f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7eee3b: serviceaccount "payload-processing-e2e-ipp-a-7eee3b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7eee3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7eee3b-6648d989f8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-7cc5bd8f47-tmvjl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-68dccf59d-qk2x8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

ProbeError

Readiness probe error: Get "http://10.133.0.104:15021/healthz/ready": read tcp 10.133.0.2:44440->10.133.0.104:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

Unhealthy

Readiness probe failed: Get "http://10.133.0.104:15021/healthz/ready": read tcp 10.133.0.2:44440->10.133.0.104:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-266486-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-5d768b897f-qs554

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-266486-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-56d5b8f9c6-fgv7s

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096834-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096834-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-pk78c

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 10 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-pk78c

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b2fvc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-951ad1-566fb4ff59-wmdq5

Unhealthy

Readiness probe failed: dial tcp 10.132.0.130:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-951ad1-7d788c86d-tmc8p

Killing

Stopping container payload-processing
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096834-d65c9bd64

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-096834-d65c9bd64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096834: serviceaccount "payload-processing-e2e-ipp-b-096834" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-096834-d65c9bd64

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096834-bf586ccff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-096834-bf586ccff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-096834: serviceaccount "payload-processing-e2e-ipp-b-096834" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-096834

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-096834-bf586ccff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-096834-bf586ccff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-096834

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-096834-d65c9bd64 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096834-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-096834-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

Unhealthy

Readiness probe failed: dial tcp 10.133.0.100:9004: connect: connection refused

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 8 to 7

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7e2db2-65bd664f7d-h27f6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7e2db2-f6d54d7c9-rcfpk

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-xpkqq

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-ipp-a-951ad1-openshift-default-74bd9dcf45-h7q8f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5c57af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c57af-7cb5949746

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5c57af-7cb5949746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c57af: serviceaccount "payload-processing-e2e-ipp-b-5c57af" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5c57af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5c57af-7cb5949746 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c57af: serviceaccount "payload-processing-e2e-ipp-b-5c57af" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c57af-7cb5949746

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-7e2db2-openshift-default-547d4f89dc-w8xd2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-266486-fb74bbcbd-t999q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-266486-994d58dff-lgvzt

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5c57af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-5c57af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-876549-6858f64d9f-4rg47

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-876549-9b675db4d-mppdx

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-ab9381-openshift-default-c9868bbc7

SuccessfulCreate

Created pod: e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ab9381

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ab9381

openshift-ingress

deployment-controller

e2e-praxis-a-ab9381-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ab9381-openshift-default-c9868bbc7 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-266486-openshift-default-7b475d5bcc-djlvp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-98cf88959-fltts

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-6648d989f8-2mdgd

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ab9381-656f856d8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ab9381

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ab9381-656f856d8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ab9381

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ab9381-656f856d8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ab9381-656f856d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ab9381: serviceaccount "payload-processing-e2e-praxis-a-ab9381" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ab9381: serviceaccount "payload-processing-e2e-praxis-a-ab9381" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-431bf6-77bf6f85ff-fbcs2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-431bf6-6f845d7bb8-rcc6w

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-876549-openshift-default-749d786c77-rbgzd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-41bdda-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-41bdda

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-41bdda

openshift-ingress

replicaset-controller

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5

SuccessfulCreate

Created pod: e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-431bf6-openshift-default-7b68d97df-cpsbx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7eee3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7eee3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7eee3b-664d78c5d4 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7eee3b: serviceaccount "payload-processing-e2e-ipp-a-7eee3b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7eee3b: serviceaccount "payload-processing-e2e-ipp-a-7eee3b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-41bdda

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-41bdda

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-41bdda-69fc77588d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-41bdda-69fc77588d

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-41bdda: serviceaccount "payload-processing-e2e-praxis-a-41bdda" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-41bdda-69fc77588d

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-41bdda-69fc77588d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-41bdda: serviceaccount "payload-processing-e2e-praxis-a-41bdda" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7eee3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7eee3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9

SuccessfulCreate

Created pod: e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7f78d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7f78d4

openshift-ingress

deployment-controller

e2e-ipp-b-7f78d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-096834-bf586ccff-wmtjz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-096834-d65c9bd64-ff7gb

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7f78d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7f78d4: serviceaccount "payload-processing-e2e-ipp-b-7f78d4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7f78d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7f78d4-6bc954fc54 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7f78d4: serviceaccount "payload-processing-e2e-ipp-b-7f78d4" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7eee3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-7eee3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

ProbeError

Readiness probe error: Get "http://10.134.0.146:15021/healthz/ready": read tcp 10.134.0.2:56152->10.134.0.146:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

Unhealthy

Readiness probe failed: Get "http://10.134.0.146:15021/healthz/ready": read tcp 10.134.0.2:56152->10.134.0.146:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-c44eee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-c44eee

openshift-ingress

deployment-controller

e2e-praxis-a-c44eee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-c44eee-openshift-default-6758d9545 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-praxis-a-c44eee-openshift-default-6758d9545

SuccessfulCreate

Created pod: e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

openshift-ingress

kubelet

e2e-ipp-b-096834-openshift-default-7d7f756545-rqhnt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ec236e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ec236e

openshift-ingress

deployment-controller

e2e-praxis-b-ec236e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ec236e-openshift-default-f6575b7df from 0 to 1

openshift-ingress

multus

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-ec236e-openshift-default-f6575b7df

SuccessfulCreate

Created pod: e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-c44eee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-c44eee-67d86f69bd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c44eee-67d86f69bd

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-c44eee-67d86f69bd

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-c44eee-67d86f69bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c44eee: serviceaccount "payload-processing-e2e-praxis-a-c44eee" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-c44eee: serviceaccount "payload-processing-e2e-praxis-a-c44eee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-c44eee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg

openshift-ingress

multus

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ec236e: serviceaccount "payload-processing-e2e-praxis-b-ec236e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ec236e: serviceaccount "payload-processing-e2e-praxis-b-ec236e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ec236e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ec236e-5cdfd995f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ec236e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zvsx7

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-wrk6w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-rv92b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-49xmm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-t88qz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 7 to 5

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 6 to 5

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ab9381-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-1e9675

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-1e9675
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ab9381-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-8c5bs

openshift-ingress

multus

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-1e9675-openshift-default-7d7c758549

SuccessfulCreate

Created pod: e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

openshift-ingress

deployment-controller

e2e-praxis-b-1e9675-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-1e9675-openshift-default-7d7c758549 from 0 to 1

openshift-ingress

deployment-controller

e2e-praxis-a-41bdda-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-41bdda-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5

SuccessfulCreate

Created pod: e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

Started

Container started

openshift-ingress

multus

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ec236e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ec236e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-1e9675

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-1e9675-b4db7fc48 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1e9675-b4db7fc48

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-1e9675-b4db7fc48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1e9675: serviceaccount "payload-processing-e2e-praxis-b-1e9675" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-1e9675: serviceaccount "payload-processing-e2e-praxis-b-1e9675" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-1e9675

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-1e9675-b4db7fc48

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp

openshift-ingress

multus

payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

Unhealthy

Startup probe failed: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

ProbeError

Startup probe error: Get "http://10.132.0.148:15021/healthz/ready": dial tcp 10.132.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

Unhealthy

Startup probe failed: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

ProbeError

Startup probe error: Get "http://10.134.0.150:15021/healthz/ready": dial tcp 10.134.0.150:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1e9675-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1e9675-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-6bc954fc54-wj7r4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-7446cb464c-lsdwt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bfcvm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-xvtbl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-41bdda-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-6p2qs

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 5 to 4
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-41bdda-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-5ce7c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-5ce7c4

openshift-ingress

deployment-controller

e2e-praxis-b-5ce7c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7

SuccessfulCreate

Created pod: e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7f78d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7f78d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

ProbeError

Startup probe error: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

Unhealthy

Startup probe failed: Get "http://10.132.0.145:15021/healthz/ready": dial tcp 10.132.0.145:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7f78d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7f78d4-c859fdc56 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7f78d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5ce7c4: serviceaccount "payload-processing-e2e-praxis-b-5ce7c4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-5ce7c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7f78d4-c859fdc56

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7f78d4-c859fdc56

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7f78d4-c859fdc56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7f78d4: serviceaccount "payload-processing-e2e-ipp-b-7f78d4" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7f78d4: serviceaccount "payload-processing-e2e-ipp-b-7f78d4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-5ce7c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-5ce7c4: serviceaccount "payload-processing-e2e-praxis-b-5ce7c4" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ab9381-548c66c6f9-hs5v8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ab9381-656f856d8-lhtcn

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c44eee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c44eee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7f78d4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-7f78d4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8e3112-79d664bddb-92v9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8e3112-697b5b645f-67mvs

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 5 to 4

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ab9381-openshift-default-c9868bbc7-tjkw6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-77lx8

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Unhealthy

Readiness probe failed: Get "http://10.132.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

ProbeError

Readiness probe error: Get "http://10.132.0.147:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c44eee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-c44eee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ec236e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ec236e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7eee3b-664d78c5d4-67f46

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7eee3b-58cbc585b7-g5hs5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ec236e-7bf78d8959-6b6zg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ec236e-5cdfd995f8-qrlkn

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

ProbeError

Startup probe error: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Unhealthy

Startup probe failed: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-82z8s

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-41bdda-6d9fdf4c8c-2jk96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-82z8s

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-41bdda-69fc77588d-xq77h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-7eee3b-openshift-default-96456c9fc-dg27r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-5x7jm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 5 to 4
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-ec236e-openshift-default-f6575b7df-kwhwr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1e9675-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-1e9675-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5ce7c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5ce7c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-w9qb8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-4csjs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-41bdda-openshift-default-7cc4dd8b5-bnhn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7f78d4-c859fdc56-jzwrn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5ce7c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-5ce7c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7f78d4-fb954f9d7-2b2qr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-1e9675-56dc9fdd47-k5fcp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-7f78d4-openshift-default-7b89b6d6b9-7rcmj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-1e9675-b4db7fc48-gcbd4

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.120:50052" within 1s: context deadline exceeded

openshift-ingress

replicaset-controller

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf

SuccessfulCreate

Created pod: e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-0172c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-0172c6

openshift-ingress

deployment-controller

e2e-praxis-a-0172c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf from 0 to 1

openshift-ingress

multus

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-8e3112-openshift-default-6cf6458b87-6xw5k

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-0172c6-795556c9b6

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-0172c6-795556c9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-0172c6: serviceaccount "payload-processing-e2e-praxis-a-0172c6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-0172c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-0172c6-795556c9b6

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-0172c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-0172c6-795556c9b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-0172c6: serviceaccount "payload-processing-e2e-praxis-a-0172c6" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm

AddedInterface

Add eth0 [10.133.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-1e9675-openshift-default-7d7c758549-6hhbg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c57af-6d8484d895-78hm2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c57af-7cb5949746-79v22

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-5c57af-openshift-default-7c49498d95-l9hlw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-a124ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf

SuccessfulCreate

Created pod: e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-a124ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-a124ab

openshift-ingress

multus

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

Started

Container started

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-2461e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-2461e8

openshift-ingress

replicaset-controller

e2e-praxis-b-2461e8-openshift-default-5f794f99df

SuccessfulCreate

Created pod: e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-b-2461e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-2461e8-openshift-default-5f794f99df from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a124ab: serviceaccount "payload-processing-e2e-praxis-a-a124ab" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a124ab-66468fdbc8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-a124ab-66468fdbc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-a124ab: serviceaccount "payload-processing-e2e-praxis-a-a124ab" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-a124ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-a124ab-66468fdbc8 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-a124ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-a124ab-77cb568899 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-a124ab-66468fdbc8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-2461e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

Unhealthy

Startup probe failed: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

ProbeError

Readiness probe error: Get "http://10.133.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

ProbeError

Startup probe error: Get "http://10.133.0.131:15021/healthz/ready": dial tcp 10.133.0.131:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

Unhealthy

Readiness probe failed: Get "http://10.133.0.125:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2461e8: serviceaccount "payload-processing-e2e-praxis-b-2461e8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2461e8-865c976f74

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx
(x8)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

ProbeError

Startup probe error: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2461e8-865c976f74

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-2461e8-865c976f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2461e8: serviceaccount "payload-processing-e2e-praxis-b-2461e8" not found
(x8)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

ProbeError

Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

Unhealthy

Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-2461e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-2461e8-865c976f74 from 0 to 1
(x8)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

Unhealthy

Startup probe failed: Get "http://10.134.0.165:15021/healthz/ready": dial tcp 10.134.0.165:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

Unhealthy

Startup probe failed: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

ProbeError

Startup probe error: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

ProbeError

Startup probe error: Get "http://10.134.0.167:15021/healthz/ready": dial tcp 10.134.0.167:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

Unhealthy

Startup probe failed: Get "http://10.134.0.168:15021/healthz/ready": dial tcp 10.134.0.168:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

Unhealthy

Startup probe failed: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

ProbeError

Startup probe error: Get "http://10.133.0.125:15021/healthz/ready": dial tcp 10.133.0.125:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 6 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kp7x7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-qrkpg

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

Started

Container started

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

openshift-ingress

multus

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

AddedInterface

Add eth0 [10.134.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulCreate

Created pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulCreate

Created pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 8 to 10

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

Created

Container created

openshift-ingress

multus

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0172c6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0172c6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

Unhealthy

Startup probe failed: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

ProbeError

Startup probe error: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

ProbeError

Startup probe error: Get "http://10.132.0.182:15021/healthz/ready": dial tcp 10.132.0.182:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

Unhealthy

Startup probe failed: Get "http://10.134.0.171:15021/healthz/ready": dial tcp 10.134.0.171:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

Unhealthy

Startup probe failed: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

ProbeError

Startup probe error: Get "http://10.134.0.172:15021/healthz/ready": dial tcp 10.134.0.172:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5

SuccessfulCreate

Created pod: e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

openshift-ingress

deployment-controller

e2e-praxis-b-cc08f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-cc08f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-cc08f1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-cc08f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-cc08f1-575cb5cc76 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cc08f1: serviceaccount "payload-processing-e2e-praxis-b-cc08f1" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cc08f1: serviceaccount "payload-processing-e2e-praxis-b-cc08f1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-cc08f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-c44eee-67d86f69bd-hvbnh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-c44eee-5f6877c847-gwhmr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

ProbeError

Startup probe error: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

Unhealthy

Startup probe failed: Get "http://10.133.0.129:15021/healthz/ready": dial tcp 10.133.0.129:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a124ab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a124ab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

Unhealthy

Startup probe failed: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

ProbeError

Startup probe error: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0172c6-84c4d8584c-44b9x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0172c6-795556c9b6-mkssm

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2461e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2461e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

ProbeError

Readiness probe error: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Unhealthy

Liveness probe failed: Get "https://10.134.0.46:8000/health": context deadline exceeded

openshift-ingress

kubelet

e2e-praxis-a-0172c6-openshift-default-6dfcffb6bf-d5s84

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

Unhealthy

Readiness probe failed: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a124ab-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-a124ab-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2461e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2461e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2461e8-846d9fcf67-27mbl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2461e8-865c976f74-8r5vx

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

Unhealthy

Startup probe failed: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

ProbeError

Startup probe error: Get "http://10.134.0.173:15021/healthz/ready": dial tcp 10.134.0.173:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-b94h6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cc08f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

Unhealthy

Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-b94h6

ProbeError

Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cc08f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-c44eee-openshift-default-6758d9545-k5l44

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-a124ab-66468fdbc8-v4bfj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-a124ab-77cb568899-64cfr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

ProbeError

Readiness probe error: Get "http://10.134.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

Unhealthy

Readiness probe failed: Get "http://10.134.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

ProbeError

Readiness probe error: Get "http://10.134.0.168:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

Unhealthy

Readiness probe failed: Get "http://10.134.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cc08f1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cc08f1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

ProbeError

Readiness probe error: Get "http://10.133.0.132:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2461e8-openshift-default-5f794f99df-hwhkw

Unhealthy

Readiness probe failed: Get "http://10.133.0.132:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-5ce7c4-8b7467cc6-gtf5t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-5ce7c4-d4b4d65d7-ljkgj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 4 to 3

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2675c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2675c0

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-fzcd2

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455

SuccessfulCreate

Created pod: e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

openshift-ingress

deployment-controller

e2e-shared-a-w3-2675c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2675c0-openshift-default-766dbf4455 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-a-w2-812990-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-812990-openshift-default-875ccc45 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-812990-openshift-default-875ccc45

SuccessfulCreate

Created pod: e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-812990

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-812990

openshift-ingress

multus

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-a124ab-openshift-default-79c9dc9fdf-vkzqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-a-w1-0bda67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-0bda67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-0bda67

openshift-ingress

replicaset-controller

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9

SuccessfulCreate

Created pod: e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

openshift-ingress

multus

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2675c0: serviceaccount "payload-processing-e2e-shared-a-w3-2675c0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2675c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2675c0: serviceaccount "payload-processing-e2e-shared-a-w3-2675c0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2675c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

AddedInterface

Add eth0 [10.133.0.141/23] from ovn-kubernetes
(x16)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-b2d9z

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-812990-74fdfd6586

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-812990-74fdfd6586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-812990: serviceaccount "payload-processing-e2e-shared-a-w2-812990" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-812990

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-812990

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-812990-74fdfd6586 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cc08f1-575cb5cc76-wf7ns

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cc08f1-54c5f4f667-nqtfp

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-812990-74fdfd6586

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-812990: serviceaccount "payload-processing-e2e-shared-a-w2-812990" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-sqv2j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-0bda67: serviceaccount "payload-processing-e2e-shared-a-w1-0bda67" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-0bda67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-0bda67: serviceaccount "payload-processing-e2e-shared-a-w1-0bda67" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-0bda67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-h7h29

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-5ce7c4-openshift-default-67d98f54c7-vkkwx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w4-327e31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-327e31-openshift-default-c67659b97 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-327e31-openshift-default-c67659b97

SuccessfulCreate

Created pod: e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-327e31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-327e31

openshift-ingress

multus

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-327e31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-327e31: serviceaccount "payload-processing-e2e-shared-a-w4-327e31" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-327e31: serviceaccount "payload-processing-e2e-shared-a-w4-327e31" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-327e31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

AddedInterface

Add eth0 [10.134.0.179/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

ProbeError

Startup probe error: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

Unhealthy

Startup probe failed: Get "http://10.134.0.179:15021/healthz/ready": dial tcp 10.134.0.179:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-cc08f1-openshift-default-6b6864bbb5-ftx2x

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-9d45fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-9d45fb

openshift-ingress

multus

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulCreate

Created pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

(combined from similar events): New size: 6; reason:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulCreate

Created pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

Created

Container created

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

AddedInterface

Add eth0 [10.134.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

Started

Container started

openshift-ingress

multus

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-42220c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-42220c-openshift-default-69fcbd8647 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-9d45fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-42220c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-42220c

openshift-ingress

replicaset-controller

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647

SuccessfulCreate

Created pod: e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

openshift-ingress

multus

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9d45fb: serviceaccount "payload-processing-e2e-shared-b-w3-9d45fb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-9d45fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9d45fb: serviceaccount "payload-processing-e2e-shared-b-w3-9d45fb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j

AddedInterface

Add eth0 [10.133.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

ProbeError

Startup probe error: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

Unhealthy

Startup probe failed: Get "http://10.133.0.138:15021/healthz/ready": dial tcp 10.133.0.138:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

ProbeError

Startup probe error: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

Unhealthy

Startup probe failed: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

ProbeError

Startup probe error: Get "http://10.132.0.201:15021/healthz/ready": dial tcp 10.132.0.201:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

Unhealthy

Startup probe failed: Get "http://10.134.0.181:15021/healthz/ready": dial tcp 10.134.0.181:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-42220c-855c748588

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-42220c-855c748588-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-42220c: serviceaccount "payload-processing-e2e-shared-b-w2-42220c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-42220c-855c748588

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-42220c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-42220c-855c748588 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-42220c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-42220c: serviceaccount "payload-processing-e2e-shared-b-w2-42220c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf

SuccessfulCreate

Created pod: e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-dbe123

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-dbe123

openshift-ingress

deployment-controller

e2e-shared-b-w1-dbe123-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

AddedInterface

Add eth0 [10.133.0.155/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-5d90d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-5d90d8

openshift-ingress

deployment-controller

e2e-explicit-5d90d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-5d90d8-openshift-default-577df8c9d9 from 0 to 1

openshift-ingress

multus

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-5d90d8-openshift-default-577df8c9d9

SuccessfulCreate

Created pod: e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-2675c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-2675c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-dbe123: serviceaccount "payload-processing-e2e-shared-b-w1-dbe123" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-dbe123

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-dbe123-768c9f5958 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-dbe123: serviceaccount "payload-processing-e2e-shared-b-w1-dbe123" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-dbe123

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-5d90d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-5d90d8-84f9d86b66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5d90d8-56c8565499

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-5d90d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-5d90d8-56c8565499 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5d90d8-84f9d86b66

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5d90d8-84f9d86b66

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-5d90d8-84f9d86b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5d90d8: serviceaccount "payload-processing-e2e-explicit-5d90d8" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5d90d8-56c8565499

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-5d90d8-56c8565499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5d90d8: serviceaccount "payload-processing-e2e-explicit-5d90d8" not found

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

ProbeError

Readiness probe error: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

Unhealthy

Readiness probe failed: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-2nghm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-8d2170

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-8d2170

openshift-ingress

replicaset-controller

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f

SuccessfulCreate

Created pod: e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

openshift-ingress

deployment-controller

e2e-shared-b-w4-8d2170-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-8d2170-openshift-default-5476557d6f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-2675c0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-2675c0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-42220c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-42220c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-8d2170: serviceaccount "payload-processing-e2e-shared-b-w4-8d2170" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-8d2170

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-8d2170: serviceaccount "payload-processing-e2e-shared-b-w4-8d2170" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-8d2170

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0bda67-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0bda67-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

Unhealthy

Readiness probe failed: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

ProbeError

Readiness probe error: Get "http://10.134.0.177:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-812990-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-812990-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0bda67-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0bda67-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-327e31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-327e31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulCreate

Created pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulCreate

Created pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulCreate

Created pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

Started

Container started

openshift-ingress

multus

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

Started

Container started

openshift-ingress

multus

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

Unhealthy

Readiness probe failed: Get "http://10.133.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

ProbeError

Readiness probe error: Get "http://10.133.0.155:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

Unhealthy

Startup probe failed: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

ProbeError

Startup probe error: Get "http://10.132.0.205:15021/healthz/ready": dial tcp 10.132.0.205:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

Unhealthy

Startup probe failed: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

ProbeError

Startup probe error: Get "http://10.134.0.192:15021/healthz/ready": dial tcp 10.134.0.192:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

Unhealthy

Startup probe failed: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

ProbeError

Startup probe error: Get "http://10.134.0.180:15021/healthz/ready": dial tcp 10.134.0.180:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

ProbeError

Readiness probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

Unhealthy

Readiness probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

ProbeError

Startup probe error: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

Unhealthy

Startup probe failed: Get "http://10.133.0.155:15021/healthz/ready": dial tcp 10.133.0.155:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

ProbeError

Startup probe error: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

Unhealthy

Startup probe failed: Get "http://10.133.0.152:15021/healthz/ready": dial tcp 10.133.0.152:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-327e31-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-327e31-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

ProbeError

Startup probe error: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

Unhealthy

Startup probe failed: Get "http://10.132.0.203:15021/healthz/ready": dial tcp 10.132.0.203:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5d90d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5d90d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-42220c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-42220c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

Unhealthy

Startup probe failed: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

ProbeError

Startup probe error: Get "http://10.133.0.158:15021/healthz/ready": dial tcp 10.133.0.158:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-dbe123-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulCreate

Created pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-dbe123-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulCreate

Created pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 4 to 7

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulCreate

Created pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

AddedInterface

Add eth0 [10.134.0.194/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5d90d8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-5d90d8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

Unhealthy

Startup probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

ProbeError

Startup probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

Unhealthy

Startup probe failed: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

ProbeError

Startup probe error: Get "http://10.133.0.162:15021/healthz/ready": dial tcp 10.133.0.162:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

ProbeError

Startup probe error: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

Unhealthy

Startup probe failed: Get "http://10.134.0.194:15021/healthz/ready": dial tcp 10.134.0.194:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-8d2170-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-8d2170-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9

SuccessfulCreate

Created pod: e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0bda67-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w1-0bda67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9 from 1 to 2

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d90d8-84f9d86b66-v45sx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d90d8-56c8565499-6568k

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

ProbeError

Startup probe error: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

Unhealthy

Startup probe failed: Get "http://10.132.0.212:15021/healthz/ready": dial tcp 10.132.0.212:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-5d90d8-openshift-default-577df8c9d9-cjd27

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-noten-e1a321-openshift-default-6ccc876f6c

SuccessfulCreate

Created pod: e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

openshift-ingress

gateway_labeler_controller

e2e-noten-e1a321

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-e1a321

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-sn5mv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-noten-e1a321-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-e1a321-openshift-default-6ccc876f6c from 0 to 1

openshift-ingress

multus

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-ljzls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-e1a321-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-e1a321-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-e1a321-openshift-default-6ccc876f6c-zqqrv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-11575-e07a4a

Started

Container started

opendatahub

kubelet

test-curl-11575-e07a4a

Created

Container created

opendatahub

kubelet

test-curl-11575-e07a4a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11575-e07a4a

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11575-54de04

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11575-54de04

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11575-54de04

Started

Container started

opendatahub

kubelet

test-curl-11575-e07a4a

Killing

Stopping container test-curl-11575-e07a4a

opendatahub

kubelet

test-curl-11575-54de04

Created

Container created

openshift-ingress

deployment-controller

e2e-shared-a-w0-73bafc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-73bafc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-73bafc

opendatahub

kubelet

test-curl-11575-54de04

Killing

Stopping container test-curl-11575-54de04

openshift-ingress

replicaset-controller

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459

SuccessfulCreate

Created pod: e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

openshift-ingress

multus

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-73bafc: serviceaccount "payload-processing-e2e-shared-a-w0-73bafc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-73bafc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-73bafc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-73bafc: serviceaccount "payload-processing-e2e-shared-a-w0-73bafc" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5

AddedInterface

Add eth0 [10.134.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc

SuccessfulCreate

Created pod: e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-dd0628

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-dd0628

openshift-ingress

deployment-controller

e2e-shared-b-w0-dd0628-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-dd0628-openshift-default-54686d76fc from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-q5glm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-dd0628

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-dd0628-996645978

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-dd0628: serviceaccount "payload-processing-e2e-shared-b-w0-dd0628" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-dd0628

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-dd0628-996645978 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-dd0628-996645978

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-dd0628-996645978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-dd0628: serviceaccount "payload-processing-e2e-shared-b-w0-dd0628" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j

AddedInterface

Add eth0 [10.133.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k

AddedInterface

Add eth0 [10.133.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-lzlcz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-8f6h2

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-4w4qc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-mcrfm
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-9bpr4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-4h7hn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

ProbeError

Startup probe error: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

Unhealthy

Startup probe failed: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-8k489

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-zsp67

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-73bafc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-73bafc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-9ld6q

opendatahub

kubelet

test-curl-11581-ccb939

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-11581-ccb939

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 676ms (676ms including waiting). Image size: 106100986 bytes.

opendatahub

multus

test-curl-11581-ccb939

AddedInterface

Add eth0 [10.133.0.167/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11581-ccb939

Created

Container created

opendatahub

kubelet

test-curl-11581-ccb939

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-73bafc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-73bafc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-11581-ccb939

Killing

Stopping container test-curl-11581-ccb939

opendatahub

kubelet

test-curl-11581-beec74

Started

Container started

opendatahub

kubelet

test-curl-11581-beec74

Created

Container created

opendatahub

kubelet

test-curl-11581-beec74

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11581-beec74

AddedInterface

Add eth0 [10.133.0.168/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11581-9ddde6

Created

Container created

opendatahub

kubelet

test-curl-11581-9ddde6

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11581-beec74

Killing

Stopping container test-curl-11581-beec74

opendatahub

kubelet

test-curl-11581-9ddde6

Started

Container started

opendatahub

multus

test-curl-11581-9ddde6

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-512ec5-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target
(x3)

openshift-ingress

deployment-controller

e2e-worker-w4-512ec5-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-512ec5-openshift-default-64bf6cc76c from 2 to 1

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c

SuccessfulDelete

Deleted pod: e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-gk4rg

opendatahub

kubelet

test-curl-11581-2e9061

Started

Container started

opendatahub

kubelet

test-curl-11581-9ddde6

Killing

Stopping container test-curl-11581-9ddde6

opendatahub

kubelet

test-curl-11581-2e9061

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11581-2e9061

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11581-2e9061

Created

Container created

opendatahub

kubelet

test-curl-11587-c10d24

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-11587-c10d24

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-bvpc2

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-11587-c10d24

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.117s (2.117s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11587-c10d24

Created

Container created

opendatahub

kubelet

test-curl-11581-2e9061

Killing

Stopping container test-curl-11581-2e9061

opendatahub

kubelet

test-curl-11587-c10d24

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

openshift-ingress

replicaset-controller

e2e-extmod-a-a786af-openshift-default-f89f5ffc7

SuccessfulCreate

Created pod: e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

openshift-ingress

deployment-controller

e2e-extmod-a-a786af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-a786af-openshift-default-f89f5ffc7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-a786af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-a786af

openshift-ingress

multus

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11587-c10d24

Killing

Stopping container test-curl-11587-c10d24

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-rhhh8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-extmod-a-2545c7-openshift-default-69cf958465

SuccessfulCreate

Created pod: e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-a-2545c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-2545c7-openshift-default-69cf958465 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-2545c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-2545c7
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7

SuccessfulCreate

Created pod: e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a786af: serviceaccount "payload-processing-e2e-extmod-a-a786af" not found

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-6ad1da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-6ad1da

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-a786af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-a786af-77cfc68667 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-a786af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-a786af-6665cd87c4 from 0 to 1

openshift-ingress

deployment-controller

e2e-extmod-a-6ad1da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-6ad1da-openshift-default-54875f9cc7 from 0 to 1
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 6 to 5

openshift-ingress

multus

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-7z8r7

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22

AddedInterface

Add eth0 [10.134.0.202/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a786af-6665cd87c4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-a786af-6665cd87c4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-a786af-6665cd87c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-a786af: serviceaccount "payload-processing-e2e-extmod-a-a786af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

multus

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-p2gnx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6ad1da-87498f66b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-6ad1da-87498f66b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6ad1da: serviceaccount "payload-processing-e2e-extmod-a-6ad1da" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-dbe123-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2

openshift-ingress

deployment-controller

e2e-shared-b-w1-dbe123-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf from 1 to 2

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-6ad1da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-6ad1da-87498f66b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf

SuccessfulCreate

Created pod: e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-6ad1da: serviceaccount "payload-processing-e2e-extmod-a-6ad1da" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-6ad1da-87498f66b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-6ad1da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf

Created

Container created

openshift-ingress

multus

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

Unhealthy

Startup probe failed: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

ProbeError

Startup probe error: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2545c7: serviceaccount "payload-processing-e2e-extmod-a-2545c7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-2545c7: serviceaccount "payload-processing-e2e-extmod-a-2545c7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-2545c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-2545c7-5966c9ddb8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-2545c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-2545c7-6549664b79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

AddedInterface

Add eth0 [10.134.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

ProbeError

Startup probe error: Get "http://10.132.0.230:15021/healthz/ready": dial tcp 10.132.0.230:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

Unhealthy

Startup probe failed: Get "http://10.132.0.230:15021/healthz/ready": dial tcp 10.132.0.230:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-npddp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-2vgx4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-f7464f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-f7464f-openshift-default-696b559f45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-f7464f-openshift-default-696b559f45

SuccessfulCreate

Created pod: e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

openshift-ingress

multus

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-f7464f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-f7464f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-f7464f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-f7464f-7bb7854df4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-f7464f-7bb7854df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-f7464f: serviceaccount "payload-processing-e2e-extmod-a-f7464f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-f7464f-7bb7854df4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-f7464f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-f7464f-7bb7854df4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-f7464f: serviceaccount "payload-processing-e2e-extmod-a-f7464f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

AddedInterface

Add eth0 [10.134.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

AddedInterface

Add eth0 [10.134.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-autores-ac674b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-ac674b

openshift-ingress

deployment-controller

e2e-autores-ac674b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-ac674b-openshift-default-798564ccc7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-ac674b-openshift-default-798564ccc7

SuccessfulCreate

Created pod: e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

openshift-ingress

multus

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-ac674b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-ac674b-7b6468ff8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-ac674b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-ac674b-79fb85957f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ac674b-7b6468ff8

FailedCreate

Error creating: pods "payload-processing-e2e-autores-ac674b-7b6468ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ac674b: serviceaccount "payload-processing-e2e-autores-ac674b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ac674b-79fb85957f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-ac674b-79fb85957f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ac674b: serviceaccount "payload-processing-e2e-autores-ac674b" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm

AddedInterface

Add eth0 [10.133.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ac674b-7b6468ff8

SuccessfulCreate

Created pod: payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-dd0628-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-dd0628-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ac674b-79fb85957f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm

openshift-ingress

multus

payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc

SuccessfulCreate

Created pod: e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

openshift-ingress

deployment-controller

e2e-extmod-b-0f7d14-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0f7d14

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0f7d14

openshift-ingress

multus

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0f7d14

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0f7d14

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0f7d14-77597d868b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0f7d14-77597d868b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0f7d14-77597d868b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0f7d14-77597d868b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0f7d14: serviceaccount "payload-processing-e2e-extmod-b-0f7d14" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0f7d14: serviceaccount "payload-processing-e2e-extmod-b-0f7d14" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6ad1da-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2545c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6ad1da-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2545c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-12fd33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-12fd33

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-0de4b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-0de4b9

openshift-ingress

replicaset-controller

e2e-extmod-b-0de4b9-openshift-default-5d57d77697

SuccessfulCreate

Created pod: e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

openshift-ingress

deployment-controller

e2e-extmod-b-0de4b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-0de4b9-openshift-default-5d57d77697 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

ProbeError

Startup probe error: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-b-12fd33-openshift-default-846b7dbb9

SuccessfulCreate

Created pod: e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj
(x5)

openshift-ingress

kubelet

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-12fd33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-12fd33-openshift-default-846b7dbb9 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

Unhealthy

Startup probe failed: Get "http://10.134.0.201:15021/healthz/ready": dial tcp 10.134.0.201:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

Unhealthy

Startup probe failed: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

ProbeError

Startup probe error: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-478gk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 7 to 6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-12fd33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-12fd33-584475c868

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-12fd33-584475c868

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-12fd33-584475c868-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-12fd33: serviceaccount "payload-processing-e2e-extmod-b-12fd33" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-12fd33: serviceaccount "payload-processing-e2e-extmod-b-12fd33" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-12fd33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-12fd33-584475c868 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-0de4b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-0de4b9-546f7db65d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9

AddedInterface

Add eth0 [10.134.0.216/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0de4b9-546f7db65d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-0de4b9-546f7db65d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-0de4b9-546f7db65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0de4b9: serviceaccount "payload-processing-e2e-extmod-b-0de4b9" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-0de4b9: serviceaccount "payload-processing-e2e-extmod-b-0de4b9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-0de4b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0f7d14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0f7d14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a786af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-a786af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-ecb3aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-ecb3aa

openshift-ingress

deployment-controller

e2e-extmod-b-ecb3aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc

SuccessfulCreate

Created pod: e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6ad1da-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-6ad1da-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ecb3aa: serviceaccount "payload-processing-e2e-extmod-b-ecb3aa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-ecb3aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-ecb3aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-ecb3aa-6944494cb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ecb3aa-6944494cb

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-ecb3aa-6944494cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ecb3aa: serviceaccount "payload-processing-e2e-extmod-b-ecb3aa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ecb3aa-6944494cb

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9

AddedInterface

Add eth0 [10.133.0.176/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f7464f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f7464f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

ProbeError

Startup probe error: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

Unhealthy

Startup probe failed: Get "http://10.134.0.208:15021/healthz/ready": dial tcp 10.134.0.208:15021: connect: connection refused
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2545c7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-2545c7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ac674b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ac674b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:
(x5)

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-lblbm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-wq96b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ac674b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-ac674b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f7464f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-f7464f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

Unhealthy

Startup probe failed: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

ProbeError

Startup probe error: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0f7d14-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0f7d14-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ac674b-79fb85957f-6zscm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ac674b-7b6468ff8-xnqpq

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0de4b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0de4b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12fd33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12fd33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

ProbeError

Startup probe error: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

Unhealthy

Startup probe failed: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0de4b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-0de4b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

Unhealthy

Readiness probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12fd33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12fd33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

ProbeError

Readiness probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

ProbeError

Startup probe error: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

Unhealthy

Startup probe failed: Get "http://10.132.0.236:15021/healthz/ready": dial tcp 10.132.0.236:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ecb3aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ecb3aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-extmod-a-10f364-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-10f364-openshift-default-965d4bfd5 from 0 to 1

openshift-ingress

kubelet

e2e-autores-ac674b-openshift-default-798564ccc7-2nk9v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-extmod-a-10f364-openshift-default-965d4bfd5

SuccessfulCreate

Created pod: e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-10f364

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-10f364

openshift-ingress

multus

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-10f364-747496b57f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-10f364-dc7459d8d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-10f364

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-10f364-747496b57f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-10f364-747496b57f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-10f364-747496b57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-10f364: serviceaccount "payload-processing-e2e-extmod-a-10f364" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-10f364-dc7459d8d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-10f364-dc7459d8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-10f364: serviceaccount "payload-processing-e2e-extmod-a-10f364" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-10f364

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-10f364-dc7459d8d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv

AddedInterface

Add eth0 [10.133.0.182/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ecb3aa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ecb3aa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-rflkd

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-z4985

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 6 to 4

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-4rpkt

openshift-ingress

replicaset-controller

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf

SuccessfulCreate

Created pod: e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

openshift-ingress

deployment-controller

e2e-extmod-b-fddaa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fddaa3-openshift-default-668fdb7bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-fddaa3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-fddaa3

openshift-ingress

multus

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

AddedInterface

Add eth0 [10.132.1.4/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Unhealthy

Readiness probe failed: Get "http://10.132.0.239:15021/healthz/ready": read tcp 10.132.0.2:42184->10.132.0.239:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

ProbeError

Readiness probe error: Get "http://10.132.0.239:15021/healthz/ready": read tcp 10.132.0.2:42184->10.132.0.239:15021: read: connection reset by peer body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fddaa3: serviceaccount "payload-processing-e2e-extmod-b-fddaa3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-fddaa3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-fddaa3-68dc868d8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fddaa3-68dc868d8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-fddaa3-68dc868d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fddaa3: serviceaccount "payload-processing-e2e-extmod-b-fddaa3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-fddaa3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fddaa3-68dc868d8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

openshift-ingress

multus

payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Unhealthy

Startup probe failed: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

ProbeError

Startup probe error: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-10f364-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-10f364-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d5bdfd759 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-d5bdfd759

SuccessfulCreate

Created pod: payload-processing-external-model-d5bdfd759-stjl2
(x6)

models-as-a-service

replicaset-controller

payload-processing-external-model-d5bdfd759

FailedCreate

Error creating: pods "payload-processing-external-model-d5bdfd759-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-d5bdfd759-stjl2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-d5bdfd759-stjl2

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-d5bdfd759-stjl2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-d5bdfd759-stjl2

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

ProbeError

Readiness probe error: Get "http://10.132.1.4:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

Unhealthy

Readiness probe failed: Get "http://10.132.1.4:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

Unhealthy

Startup probe failed: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

ProbeError

Startup probe error: Get "http://10.132.1.4:15021/healthz/ready": dial tcp 10.132.1.4:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fddaa3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fddaa3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

replicaset-controller

payload-processing-external-model-869554dfbc

SuccessfulCreate

Created pod: payload-processing-external-model-869554dfbc-tvkrp

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-869554dfbc from 0 to 1

models-as-a-service

multus

payload-processing-external-model-869554dfbc-tvkrp

AddedInterface

Add eth0 [10.134.0.236/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-869554dfbc-tvkrp

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-869554dfbc-tvkrp

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-869554dfbc-tvkrp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-d5bdfd759 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-d5bdfd759-stjl2

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-d5bdfd759

SuccessfulDelete

Deleted pod: payload-processing-external-model-d5bdfd759-stjl2
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-5smp6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

AddedInterface

Add eth0 [10.134.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

ProbeError

Startup probe error: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

Unhealthy

Startup probe failed: Get "http://10.132.1.9:15021/healthz/ready": dial tcp 10.132.1.9:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

Unhealthy

Startup probe failed: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

ProbeError

Startup probe error: Get "http://10.134.0.237:15021/healthz/ready": dial tcp 10.134.0.237:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-7tbjq
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

(combined from similar events): New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-7tbjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-7tbjq

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-7tbjq

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-7tbjq

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-7tbjq

ProbeError

Startup probe error: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Unhealthy

Startup probe failed: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

ProbeError

Startup probe error: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-7tbjq

Unhealthy

Startup probe failed: Get "http://10.134.0.238:15021/healthz/ready": dial tcp 10.134.0.238:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Unhealthy

Startup probe failed: Get "http://10.133.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

ProbeError

Startup probe error: Get "http://10.133.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-xcqb4
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target
(x4)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled up replica set maas-default-gateway-openshift-default-55f85cf5d7 from 6 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-64b8599cdb

SuccessfulCreate

Created pod: payload-processing-external-model-64b8599cdb-bxjhm

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-bxjhm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-bxjhm

Started

Container started

models-as-a-service

multus

payload-processing-external-model-64b8599cdb-bxjhm

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-bxjhm

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-64b8599cdb

SuccessfulDelete

Deleted pod: payload-processing-external-model-64b8599cdb-bxjhm
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

Unhealthy

Startup probe failed: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

ProbeError

Startup probe error: Get "http://10.133.0.196:15021/healthz/ready": dial tcp 10.133.0.196:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-bxjhm

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

ProbeError

Startup probe error: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused body:
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-64b8599cdb from 0 to 1
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

ProbeError

Startup probe error: Get "http://10.132.1.12:15021/healthz/ready": dial tcp 10.132.1.12:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

Unhealthy

Startup probe failed: Get "http://10.132.1.11:15021/healthz/ready": dial tcp 10.132.1.11:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

Unhealthy

Startup probe failed: Get "http://10.132.1.12:15021/healthz/ready": dial tcp 10.132.1.12:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-64b8599cdb

SuccessfulCreate

Created pod: payload-processing-external-model-64b8599cdb-z7hls

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-z7hls

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-z7hls

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-z7hls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-64b8599cdb-z7hls

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-64b8599cdb

SuccessfulDelete

Deleted pod: payload-processing-external-model-64b8599cdb-z7hls

models-as-a-service

kubelet

payload-processing-external-model-64b8599cdb-z7hls

Killing

Stopping container payload-processing
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-64b8599cdb from 1 to 0

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-696c89547b from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-696c89547b

SuccessfulCreate

Created pod: payload-processing-external-model-696c89547b-6ftjg

models-as-a-service

multus

payload-processing-external-model-696c89547b-6ftjg

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-696c89547b-6ftjg

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-696c89547b-6ftjg

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-696c89547b-6ftjg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-696c89547b from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-696c89547b

SuccessfulDelete

Deleted pod: payload-processing-external-model-696c89547b-6ftjg

models-as-a-service

kubelet

payload-processing-external-model-696c89547b-6ftjg

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 4 to 3

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

Unhealthy

Readiness probe failed: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-4t45f

ProbeError

Readiness probe error: Get "http://10.132.0.209:15021/healthz/ready": dial tcp 10.132.0.209:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

ProbeError

Readiness probe error: Get "http://10.133.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Unhealthy

Readiness probe failed: Get "http://10.133.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-99c554458 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-99c554458

SuccessfulCreate

Created pod: payload-processing-external-model-99c554458-p54jm

models-as-a-service

kubelet

payload-processing-external-model-99c554458-p54jm

Started

Container started

models-as-a-service

multus

payload-processing-external-model-99c554458-p54jm

AddedInterface

Add eth0 [10.134.0.241/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-99c554458-p54jm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-99c554458-p54jm

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-869554dfbc

SuccessfulDelete

Deleted pod: payload-processing-external-model-869554dfbc-tvkrp

models-as-a-service

kubelet

payload-processing-external-model-869554dfbc-tvkrp

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-869554dfbc from 1 to 0

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

Unhealthy

Readiness probe failed: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

ProbeError

Readiness probe error: Get "http://10.132.1.9:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x7)

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 3 to 2
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-l5gdx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 3 to 2

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-pzxkx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

models-as-a-service

replicaset-controller

payload-processing-external-model-6c9884c959

SuccessfulCreate

Created pod: payload-processing-external-model-6c9884c959-7qlvl

models-as-a-service

kubelet

payload-processing-external-model-6c9884c959-7qlvl

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6c9884c959-7qlvl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6c9884c959-7qlvl

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6c9884c959-7qlvl

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-eab799

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-eab799

openshift-ingress

deployment-controller

e2e-inf-a-eab799-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-eab799-openshift-default-574ddfd59c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-eab799-openshift-default-574ddfd59c

SuccessfulCreate

Created pod: e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

openshift-ingress

multus

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

AddedInterface

Add eth0 [10.132.1.24/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-eab799

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-eab799-6cd45b65f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-eab799

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-eab799-574789c6bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-eab799-574789c6bb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-eab799-574789c6bb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-eab799-574789c6bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-eab799: serviceaccount "payload-processing-e2e-inf-a-eab799" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-eab799: serviceaccount "payload-processing-e2e-inf-a-eab799" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

openshift-ingress

multus

payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-99c554458-p54jm

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-99c554458

SuccessfulDelete

Deleted pod: payload-processing-external-model-99c554458-p54jm

openshift-ingress

gateway_labeler_controller

e2e-inf-a-63f4e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-63f4e4

openshift-ingress

deployment-controller

e2e-inf-a-63f4e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-63f4e4-openshift-default-786cd844c9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-63f4e4-openshift-default-786cd844c9

SuccessfulCreate

Created pod: e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

openshift-ingress

multus

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

AddedInterface

Add eth0 [10.132.1.30/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-63f4e4: serviceaccount "payload-processing-e2e-inf-a-63f4e4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-63f4e4: serviceaccount "payload-processing-e2e-inf-a-63f4e4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-63f4e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-63f4e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6b67f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6b67f8

openshift-ingress

deployment-controller

e2e-inf-a-6b67f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6b67f8-openshift-default-696ff8b6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-6b67f8-openshift-default-696ff8b6f

SuccessfulCreate

Created pod: e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

openshift-ingress

multus

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

AddedInterface

Add eth0 [10.132.1.31/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6b67f8: serviceaccount "payload-processing-e2e-inf-a-6b67f8" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6b67f8: serviceaccount "payload-processing-e2e-inf-a-6b67f8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6b67f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6b67f8-8564b6d7d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6b67f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv

AddedInterface

Add eth0 [10.134.0.248/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-6kdzn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-0bda67-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-0bda67-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

models-as-a-service

replicaset-controller

payload-processing-external-model-7f7cbc76ff

SuccessfulCreate

Created pod: payload-processing-external-model-7f7cbc76ff-559nv

models-as-a-service

kubelet

payload-processing-external-model-7f7cbc76ff-559nv

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7f7cbc76ff-559nv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7f7cbc76ff-559nv

AddedInterface

Add eth0 [10.134.0.249/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7f7cbc76ff-559nv

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1333c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1333c8

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-2s2dq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-inf-a-1333c8-openshift-default-847ccc6485

SuccessfulCreate

Created pod: e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

openshift-ingress

deployment-controller

e2e-inf-a-1333c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1333c8-openshift-default-847ccc6485 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e9f184

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e9f184

openshift-ingress

replicaset-controller

e2e-inf-b-e9f184-openshift-default-55dd875b9f

SuccessfulCreate

Created pod: e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

openshift-ingress

deployment-controller

e2e-inf-b-e9f184-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e9f184-openshift-default-55dd875b9f from 0 to 1

openshift-ingress

multus

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

AddedInterface

Add eth0 [10.132.1.33/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

AddedInterface

Add eth0 [10.132.1.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1333c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1333c8-57c4665659 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1333c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1333c8-68778777f4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1333c8-68778777f4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1333c8-68778777f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1333c8: serviceaccount "payload-processing-e2e-inf-a-1333c8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1333c8-57c4665659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1333c8-68778777f4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1333c8-57c4665659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1333c8-57c4665659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1333c8: serviceaccount "payload-processing-e2e-inf-a-1333c8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

AddedInterface

Add eth0 [10.134.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e9f184-64d65589f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e9f184-64d65589f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e9f184: serviceaccount "payload-processing-e2e-inf-b-e9f184" not found

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Unhealthy

Readiness probe failed: Get "http://10.132.1.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

ProbeError

Readiness probe error: Get "http://10.132.1.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e9f184

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e9f184-64d65589f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e9f184: serviceaccount "payload-processing-e2e-inf-b-e9f184" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e9f184

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e9f184-76fc4c8bbd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e9f184-64d65589f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-6c9884c959

SuccessfulDelete

Deleted pod: payload-processing-external-model-6c9884c959-7qlvl

models-as-a-service

kubelet

payload-processing-external-model-6c9884c959-7qlvl

Killing

Stopping container payload-processing
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

(combined from similar events): Scaled down replica set payload-processing-external-model-6c9884c959 from 1 to 0
(x2)

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

ProbeError

Startup probe error: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Unhealthy

Startup probe failed: Get "http://10.132.1.24:15021/healthz/ready": dial tcp 10.132.1.24:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-eab799-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-eab799-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

Unhealthy

Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9x4ps

ProbeError

Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-eab799-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-eab799-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

Unhealthy

Startup probe failed: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

Unhealthy

Startup probe failed: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

ProbeError

Startup probe error: Get "http://10.132.1.30:15021/healthz/ready": dial tcp 10.132.1.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

ProbeError

Startup probe error: Get "http://10.132.1.31:15021/healthz/ready": dial tcp 10.132.1.31:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6b67f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6b67f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-63f4e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-63f4e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

models-as-a-service

kubelet

payload-processing-external-model-7f7cbc76ff-559nv

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-734ffe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-734ffe

openshift-ingress

deployment-controller

e2e-inf-b-734ffe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-734ffe-openshift-default-5db45fbc99 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-734ffe-openshift-default-5db45fbc99

SuccessfulCreate

Created pod: e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

openshift-ingress

multus

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

AddedInterface

Add eth0 [10.132.1.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-734ffe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-734ffe-578944ccfb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-734ffe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-734ffe-646746456c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-734ffe-578944ccfb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-734ffe-578944ccfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-734ffe: serviceaccount "payload-processing-e2e-inf-b-734ffe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-734ffe-578944ccfb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-734ffe-646746456c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-734ffe-646746456c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-734ffe: serviceaccount "payload-processing-e2e-inf-b-734ffe" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-734ffe-646746456c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

AddedInterface

Add eth0 [10.133.0.213/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-63f4e4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-63f4e4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-b-befaa6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-befaa6

openshift-ingress

deployment-controller

e2e-inf-b-befaa6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-befaa6-openshift-default-767bb98587 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-befaa6-openshift-default-767bb98587

SuccessfulCreate

Created pod: e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

openshift-ingress

multus

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

AddedInterface

Add eth0 [10.132.1.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-befaa6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-befaa6-56d77cf7d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-befaa6: serviceaccount "payload-processing-e2e-inf-b-befaa6" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-befaa6-56d77cf7d4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-befaa6-56d77cf7d4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-befaa6-56d77cf7d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-befaa6: serviceaccount "payload-processing-e2e-inf-b-befaa6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-befaa6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6b67f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-6b67f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Unhealthy

Readiness probe failed: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

ProbeError

Readiness probe error: Get "http://10.132.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-befaa6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-befaa6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

Unhealthy

Startup probe failed: Get "http://10.132.1.34:15021/healthz/ready": dial tcp 10.132.1.34:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

ProbeError

Startup probe error: Get "http://10.132.1.34:15021/healthz/ready": dial tcp 10.132.1.34:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9c3f12

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9c3f12

openshift-ingress

deployment-controller

e2e-inf-b-9c3f12-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9c3f12-openshift-default-78b944cc9c from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-9c3f12-openshift-default-78b944cc9c

SuccessfulCreate

Created pod: e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

openshift-ingress

multus

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

AddedInterface

Add eth0 [10.132.1.38/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e9f184-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-e9f184-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

ProbeError

Readiness probe error: Get "http://10.132.1.33:15021/healthz/ready": read tcp 10.132.0.2:54044->10.132.1.33:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Unhealthy

Readiness probe failed: Get "http://10.132.1.33:15021/healthz/ready": read tcp 10.132.0.2:54044->10.132.1.33:15021: read: connection reset by peer
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9c3f12: serviceaccount "payload-processing-e2e-inf-b-9c3f12" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9c3f12

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9c3f12-7f464c7b8b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9c3f12: serviceaccount "payload-processing-e2e-inf-b-9c3f12" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9c3f12

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9c3f12-549d99f87 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc

AddedInterface

Add eth0 [10.133.0.215/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Unhealthy

Startup probe failed: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

ProbeError

Startup probe error: Get "http://10.132.1.33:15021/healthz/ready": dial tcp 10.132.1.33:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1333c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1333c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9c3f12-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9c3f12-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1333c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-1333c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

ProbeError

Startup probe error: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

Unhealthy

Startup probe failed: Get "http://10.132.1.36:15021/healthz/ready": dial tcp 10.132.1.36:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-734ffe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-734ffe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

ProbeError

Startup probe error: Get "http://10.132.1.37:15021/healthz/ready": dial tcp 10.132.1.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

Unhealthy

Startup probe failed: Get "http://10.132.1.37:15021/healthz/ready": dial tcp 10.132.1.37:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-734ffe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-734ffe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-befaa6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-befaa6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

Unhealthy

Startup probe failed: Get "http://10.132.1.38:15021/healthz/ready": dial tcp 10.132.1.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

ProbeError

Startup probe error: Get "http://10.132.1.38:15021/healthz/ready": dial tcp 10.132.1.38:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9c3f12-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9c3f12-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-9d45fb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-9d45fb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-hgjr6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-6a7148-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-6a7148-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-6a7148-openshift-default-94c7bfd7c from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c

SuccessfulDelete

Deleted pod: e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-tjnq5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-dbe123-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w1-dbe123-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf

SuccessfulDelete

Deleted pod: e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-vqtxj

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-47fd99-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-47fd99-openshift-default-75b64cdc59 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-47fd99-openshift-default-75b64cdc59

SuccessfulDelete

Deleted pod: e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-47fd99-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-j8kfd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-worker-w0-f920f7-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f920f7-openshift-default-7c9767c97 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f920f7-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-f920f7-openshift-default-7c9767c97

SuccessfulDelete

Deleted pod: e2e-worker-w0-f920f7-openshift-default-7c9767c97-vjsqk

openshift-ingress

deployment-controller

e2e-worker-w1-c1b1e8-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c1b1e8-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9

SuccessfulDelete

Deleted pod: e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-rtxmt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eab799-574789c6bb-czsnf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-5smp6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xnnfx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-5smp6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 10 to 5

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-xcqb4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-d9b94
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-qtfcj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-xnnfx
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-f7464f-7bb7854df4-5mz6r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-f7464f-799f6f7cdc-j5lv9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-d9b94

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-f7464f-openshift-default-696b559f45-jm5ts

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eab799-6cd45b65f-97l7x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-bc9xz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 5 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-bc9xz
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-eab799-openshift-default-574ddfd59c-tfw7h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecb3aa-6944494cb-82jdq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecb3aa-5cf4f4d675-5w5k9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9f184-76fc4c8bbd-t4d9m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9f184-64d65589f-s7qf7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-ecb3aa-openshift-default-68d9fff7cc-xb5ct

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-e9f184-openshift-default-55dd875b9f-jjt74

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-0bda67-64b9d5945d-qcqh7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-0bda67-767cdbf49f-v2thk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-6ad1da-74c77954b7-frpq2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-6ad1da-87498f66b-wqcxf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-0bda67-openshift-default-bdbd7b8d9-fr7n8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6b67f8-8564b6d7d6-j6hmv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-6ad1da-openshift-default-54875f9cc7-btpwf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-dbe123-6bf45ccd5f-8sf4n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-dbe123-768c9f5958-cbc4g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-dbe123-openshift-default-d74b4dcdf-nntkd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6b67f8-86cc7b4f9-8lvcs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-kxnqt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

Killing

Stopping container payload-processing
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 4 to 3

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-63f4e4-openshift-default-786cd844c9-lxsbx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-63f4e4-6f85b5b8b8-7k6r8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-63f4e4-6d7899569f-k898c

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0de4b9-546f7db65d-sgbl9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0de4b9-f9547c6ff-fxsfg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-6b67f8-openshift-default-696ff8b6f-6t5q2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c1b1e8-54768d8dbc-fcmh7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c1b1e8-747b9c5d56-hf5pp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-befaa6-56d77cf7d4-t65jm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-0de4b9-openshift-default-5d57d77697-g7ct6

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-734ffe-646746456c-2t5vj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-734ffe-578944ccfb-xk68r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-73bafc-5bcf696c9b-qlgb7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-73bafc-5754b675dc-728g5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1333c8-68778777f4-2kxd5

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-befaa6-86b4b8bcf9-jd94g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-734ffe-openshift-default-5db45fbc99-5vzmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-befaa6-openshift-default-767bb98587-6bvqz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-c1b1e8-openshift-default-6c6975cfc9-jr984

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1333c8-57c4665659-vmffs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w0-73bafc-openshift-default-64bfdb8459-rfkqt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-1333c8-openshift-default-847ccc6485-tp95k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-dd0628-8484bd5cbc-8sq4k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-dd0628-996645978-zqv8j

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-2545c7-6549664b79-f7qn2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-2545c7-5966c9ddb8-rjvgs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-a786af-openshift-default-f89f5ffc7-b62z2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9c3f12-7f464c7b8b-25xkc

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-a786af-77cfc68667-zlw22

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-a786af-6665cd87c4-qhw7d

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.203:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-extmod-a-2545c7-openshift-default-69cf958465-vb4sg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9c3f12-549d99f87-kxbqk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w0-dd0628-openshift-default-54686d76fc-x98kl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-0f7d14-77597d868b-sw2sg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-0f7d14-7d594659c5-vdlz8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-9c3f12-openshift-default-78b944cc9c-fdpqh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-0f7d14-openshift-default-cf79d4dcc-mcrqq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-10f364-747496b57f-cfrvv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-10f364-dc7459d8d-t9d6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12fd33-65b8dc7775-l4zkv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12fd33-584475c868-2bcrb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-12fd33-openshift-default-846b7dbb9-pt6kj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f920f7-6f98685466-qtsf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f920f7-64c9f64f6c-qs4w2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-812990-openshift-default-875ccc45-lfjcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-2675c0-openshift-default-766dbf4455-s42l2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-10f364-openshift-default-965d4bfd5-4b57q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2675c0-5c696f55dd-whl8b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2675c0-6bf8c6bc8c-gvpb2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-812990-74fdfd6586-9mkcj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-812990-cb87f9bb7-x9pdl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-f920f7-openshift-default-7c9767c97-tsxml

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-fddaa3-openshift-default-668fdb7bf-z4588

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-h89vv

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-h89vv

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-42220c-openshift-default-69fcbd8647-kjt4q

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-42220c-855c748588-jwrnx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fddaa3-68994dbf87-j6x86

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fddaa3-68dc868d8-h9mbj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-42220c-8659d6cd87-6l5x4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9d45fb-bf6d6c6bc-ngpbm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-9d45fb-openshift-default-7c5c478599-c2h2r

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9d45fb-5b5f557cb-lpd5j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-327e31-openshift-default-c67659b97-7fs5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-327e31-77c96b8867-9swbh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-327e31-7b6b59ff5d-flcqq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-47fd99-7b57d497d7-8tx7s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-47fd99-8688dd8dd8-r27mn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-6a7148-7b89464846-hktb7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-6a7148-6f4795df8c-kl6l4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w4-8d2170-openshift-default-5476557d6f-725gh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-47fd99-openshift-default-75b64cdc59-7l9ps

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-6a7148-openshift-default-94c7bfd7c-6dqgt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-8d2170-64ff67b7f8-xcgn5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-8d2170-54f4bf7fcf-l2xkz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-512ec5-5dd4cfdc96-4c8qt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-512ec5-5d778778f9-d4dw2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-512ec5-openshift-default-64bf6cc76c-dfgzb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-55f85cf5d7

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-55f85cf5d7 from 3 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-55f85cf5d7-9ngvj

Killing

Stopping container istio-proxy