Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn to ip-10-0-128-69.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp to ip-10-0-128-69.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6 to ip-10-0-129-252.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-56c7694f85sv5q4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-56c7694f85sv5q4 to ip-10-0-129-252.us-west-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcsnr to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m to ip-10-0-128-69.us-west-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-g4wbn

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-g4wbn to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh to ip-10-0-129-252.us-west-2.compute.internal

opendatahub

test-curl-7422-e1bc22

Scheduled

Successfully assigned opendatahub/test-curl-7422-e1bc22 to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

test-curl-7422-5e957c

Scheduled

Successfully assigned opendatahub/test-curl-7422-5e957c to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3145c214-openshift-default-75d84f979f-tfls4 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7 to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

odh-model-controller-769875db56-v2v7m

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-v2v7m to ip-10-0-136-214.us-west-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-cqc67

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-cqc67 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr to ip-10-0-136-214.us-west-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-5md5f

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-5md5f to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x to ip-10-0-136-214.us-west-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-pfp2l

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-pfp2l to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

maas-controller-6686485556-8hwrr

Scheduled

Successfully assigned opendatahub/maas-controller-6686485556-8hwrr to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-zhpnb to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

maas-controller-5854896b77-fj9jx

Scheduled

Successfully assigned opendatahub/maas-controller-5854896b77-fj9jx to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz to ip-10-0-129-252.us-west-2.compute.internal

kuadrant-system

authorino-57f7f8659f-z52fh

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-z52fh to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-vjrbz to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-prwvm to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-plhn5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-plhn5 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-p79qx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-p79qx to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-n8gdm to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-h4phj

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj to ip-10-0-136-214.us-west-2.compute.internal

kuadrant-system

authorino-5f87c44d4-d554c

Scheduled

Successfully assigned kuadrant-system/authorino-5f87c44d4-d554c to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587 to ip-10-0-128-69.us-west-2.compute.internal

kuadrant-system

authorino-664b5b9867-x4lkz

Scheduled

Successfully assigned kuadrant-system/authorino-664b5b9867-x4lkz to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm to ip-10-0-128-69.us-west-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-pwkw5

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-pwkw5 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68 to ip-10-0-128-69.us-west-2.compute.internal

kuadrant-system

authorino-7cc78785cc-cdrj4

Scheduled

Successfully assigned kuadrant-system/authorino-7cc78785cc-cdrj4 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz to ip-10-0-136-214.us-west-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-g8ngp

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-g8ngp to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-n4hh5 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-jxfk6 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-ccqmz

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-j94nh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-j94nh to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-7nrj5

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-7nrj5 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-hq47j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-hdk28

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7 to ip-10-0-128-69.us-west-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-gd4v5

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-gd4v5 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-cvk8n

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-cvk8n to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-flvv6 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-f6565

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-f6565 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-d9tgt to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-c5zfm to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-5df48fcc99-b8899

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-b8899 to ip-10-0-128-69.us-west-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-96g5j

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-96g5j to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8 to ip-10-0-136-214.us-west-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-sbxm2

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2 to ip-10-0-136-214.us-west-2.compute.internal

opendatahub

ai-gateway-controller-6bdf4bddbc-hwvmh

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6bdf4bddbc-hwvmh to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-sdhwx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-sdhwx to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-5f668977d-wjqtd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f668977d-wjqtd to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-5f668977d-rxr8s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f668977d-rxr8s to ip-10-0-136-214.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-d44b46b89-qvj52

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-d44b46b89-qvj52 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5 to ip-10-0-129-252.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-frcz5

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-k295k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k295k to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-8lmz6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8lmz6 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr to ip-10-0-129-252.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-77d5dcc848-45zm6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-77d5dcc848-45zm6 to ip-10-0-128-69.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-pngcr

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-nfts6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-nfts6 to ip-10-0-128-69.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-757c658c7b-pxlp8

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-757c658c7b-pxlp8 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f to ip-10-0-136-214.us-west-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-lcgvh

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-lcgvh to ip-10-0-129-252.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-6698d5675d-tkzwb

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6698d5675d-tkzwb to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc to ip-10-0-129-252.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-6698d5675d-kg28v

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6698d5675d-kg28v to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n to ip-10-0-129-252.us-west-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-4nvf6

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-4nvf6 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n to ip-10-0-136-214.us-west-2.compute.internal

cert-manager

cert-manager-597b95cb84-w2rfl

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-w2rfl to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq to ip-10-0-129-252.us-west-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52 to ip-10-0-129-252.us-west-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-9bqsl

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl to ip-10-0-136-214.us-west-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv to ip-10-0-128-69.us-west-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-srlkk

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l to ip-10-0-129-252.us-west-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-646cd44-v6vmr

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-646cd44-v6vmr to ip-10-0-129-252.us-west-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-tqv66

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-tqv66 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

router-default-7dcc875c8f-dlqlr

Scheduled

Successfully assigned openshift-ingress/router-default-7dcc875c8f-dlqlr to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

router-default-7dcc875c8f-dlqlr

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-7dcc875c8f-dlqlr

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k to ip-10-0-136-214.us-west-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj to ip-10-0-128-69.us-west-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-131718-99f467587-47lnx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m to ip-10-0-136-214.us-west-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-22fpx

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-22fpx to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-78dad9-7c985bb45-49b92

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb to ip-10-0-129-252.us-west-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-tzkq2

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-tzkq2 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-2lt96 to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb to ip-10-0-128-69.us-west-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-6756s

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-6756s to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5 to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-4qdkd

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-4qdkd to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh to ip-10-0-129-252.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg to ip-10-0-128-69.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x to ip-10-0-136-214.us-west-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7dcc875c8f from 0 to 1

openshift-ingress

replicaset-controller

router-default-7dcc875c8f

SuccessfulCreate

Created pod: router-default-7dcc875c8f-dlqlr

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-7dcc875c8f-dlqlr

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-7dcc875c8f-dlqlr

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-7dcc875c8f-dlqlr

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7dcc875c8f-dlqlr

Started

Container started

openshift-ingress

kubelet

router-default-7dcc875c8f-dlqlr

Created

Container created

openshift-ingress

kubelet

router-default-7dcc875c8f-dlqlr

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-7dcc875c8f-dlqlr

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-nfts6

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-nfts6

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.356s (4.356s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5df48fcc99 from 0 to 1

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-599fb7fb95 from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-599fb7fb95

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-vjrbz

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.421s (6.421s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-599fb7fb95-qvpdh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 7.721s (7.721s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6bd4ff4fb8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6bd4ff4fb8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6bd4ff4fb8

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-6bd4ff4fb8 from 0 to 3

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

install-jnqxz

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 5.642s (5.642s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 5.548s (5.548s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 5.64s (5.64s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-qc7z6

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 855ms (855ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 915ms (915ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 1.117s (1.117s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-srlkk

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp_f990ac14-d99b-4998-98d6-1fa2e6d84444

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-6bd4ff4fb8-rxlwp_f990ac14-d99b-4998-98d6-1fa2e6d84444 became leader

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-srlkk

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-srlkk

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-pngcr

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-pngcr

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pngcr

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-g8ngp

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

multus

authorino-operator-7b7bb4bc77-g8ngp

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-g8ngp

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-srlkk

Created

Container created

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-srlkk

Started

Container started

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-srlkk

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 8.125s (8.125s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-srlkk_e2d513f0-515e-4d4a-a9b2-8c18b90a1906 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-9bqsl

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-9bqsl

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-9bqsl

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kuadrant-system

authorino-operator-7b7bb4bc77-g8ngp_4f0672ed-30c5-4a06-bcf3-bfdf73a8cd68

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-g8ngp_4f0672ed-30c5-4a06-bcf3-bfdf73a8cd68 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-g8ngp

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-g8ngp

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-g8ngp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 4.797s (4.797s including waiting). Image size: 167738465 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pngcr

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-cqc67

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pngcr

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pngcr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 12.084s (12.084s including waiting). Image size: 424244516 bytes.
(x5)

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

FailedCreate

Error creating: pods "cert-manager-webhook-5dbbbf75cc-" is forbidden: error looking up service account cert-manager/cert-manager-webhook: serviceaccount "cert-manager-webhook" not found

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-9bqsl

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-9bqsl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 3.93s (3.93s including waiting). Image size: 177967631 bytes.

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-gd4v5

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-gd4v5

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-cqc67

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-9bqsl

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cqc67

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-pngcr_b87e2cbc-25ac-42b3-91e7-773df2b5bcb7

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-pngcr_b87e2cbc-25ac-42b3-91e7-773df2b5bcb7 became leader

kuadrant-system

limitador-operator-controller-manager-5778bb4449-9bqsl_96eb9083-46ab-4580-8456-aa6983ca11c9

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-9bqsl_96eb9083-46ab-4580-8456-aa6983ca11c9 became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gd4v5

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-sbxm2

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gd4v5

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gd4v5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 4.705s (4.705s including waiting). Image size: 190804149 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gd4v5

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sbxm2

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-sbxm2

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cqc67

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-g4wbn

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

dns-operator-controller-manager-8557cbdb84-gd4v5_c364fc6b-9601-4e14-863c-5165211f4f77

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-gd4v5_c364fc6b-9601-4e14-863c-5165211f4f77 became leader

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-g4wbn

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cqc67

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 5.18s (5.18s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cqc67

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-g4wbn

openshift-ingress

replicaset-controller

kube-auth-proxy-5f668977d

SuccessfulCreate

Created pod: kube-auth-proxy-5f668977d-wjqtd

openshift-ingress

replicaset-controller

kube-auth-proxy-5f668977d

SuccessfulCreate

Created pod: kube-auth-proxy-5f668977d-rxr8s

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-56c7694f85

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-56c7694f85sv5q4

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5f668977d from 0 to 2

openshift-ingress

multus

kube-auth-proxy-5f668977d-rxr8s

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-56c7694f85 from 0 to 1

openshift-ingress

multus

kube-auth-proxy-5f668977d-wjqtd

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-56c7694f85sv5q4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-56c7694f85sv5q4

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-rxr8s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"
(x5)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-wjqtd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing
(x12)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-56c7694f85sv5q4

Started

Container started

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-lcgvh

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-56c7694f85sv5q4

Created

Container created

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

limitador-limitador-74dfcfb894-lcgvh

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-z52fh

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-lcgvh

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-g4wbn

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-wjqtd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.707s (3.707s including waiting). Image size: 188904677 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-g4wbn

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-z52fh

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-z52fh

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-g4wbn

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.239s (4.239s including waiting). Image size: 309650901 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-wjqtd

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-wjqtd

Created

Container created

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-frcz5

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-rxr8s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 4.446s (4.446s including waiting). Image size: 188904677 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-frcz5

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sbxm2

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-rxr8s

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sbxm2

Started

Container started

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5f668977d-rxr8s

Started

Container started

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-sbxm2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.882s (6.882s including waiting). Image size: 342538866 bytes.

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-pfp2l

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-4nvf6

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-lcgvh

Created

Container created

kuadrant-system

multus

authorino-56c6c9ddd5-pfp2l

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-pfp2l

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-frcz5

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-frcz5

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-lcgvh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.749s (2.749s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4nvf6

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-4nvf6

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-frcz5

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-lcgvh

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-z52fh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.181s (3.181s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-z52fh

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-z52fh

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4nvf6

Created

Container created

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4nvf6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.678s (3.678s including waiting). Image size: 133379307 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-4nvf6

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-pfp2l

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.821s (3.821s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-pfp2l

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-z52fh

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-z52fh

kuadrant-system

kubelet

authorino-56c6c9ddd5-pfp2l

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-w2rfl

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-w2rfl

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-w2rfl

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-w2rfl

cert-manager

kubelet

cert-manager-597b95cb84-w2rfl

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-pngcr

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-pngcr

Killing

Stopping container manager

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-lcgvh

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-lcgvh

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-7nrj5

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-7nrj5

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7nrj5

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7nrj5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 4.854s (4.854s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7nrj5

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-7nrj5

Started

Container started

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-frcz5_f27471e1-e850-4fc3-bf66-5cd28fe453dc

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-frcz5_f27471e1-e850-4fc3-bf66-5cd28fe453dc became leader

opendatahub

kserve-module-controller-manager-7566cf5fc8-7nrj5_c0ec39e5-1609-4b87-86f1-8636c620216c

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-7nrj5_c0ec39e5-1609-4b87-86f1-8636c620216c became leader

opendatahub

multus

maas-controller-5854896b77-fj9jx

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-5854896b77

SuccessfulCreate

Created pod: maas-controller-5854896b77-fj9jx

opendatahub

kubelet

maas-controller-5854896b77-fj9jx

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:9a530952aa600e4e49fa239e5159c9e763ee1bc413c99a7193c3f6842e7308b4"

opendatahub

replicaset-controller

maas-controller-6686485556

SuccessfulCreate

Created pod: maas-controller-6686485556-8hwrr

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5854896b77 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6686485556 from 0 to 1

opendatahub

multus

maas-controller-6686485556-8hwrr

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6686485556-8hwrr

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:9a530952aa600e4e49fa239e5159c9e763ee1bc413c99a7193c3f6842e7308b4" in 6.613s (6.613s including waiting). Image size: 200069638 bytes.

opendatahub

kubelet

maas-controller-5854896b77-fj9jx

Created

Container created

opendatahub

kubelet

maas-controller-5854896b77-fj9jx

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:9a530952aa600e4e49fa239e5159c9e763ee1bc413c99a7193c3f6842e7308b4" in 7.164s (7.164s including waiting). Image size: 200069638 bytes.

opendatahub

kubelet

maas-controller-5854896b77-fj9jx

Started

Container started

opendatahub

maas-controller-5854896b77-fj9jx_e23c4dbe-2592-470b-801f-c5212b30cb94

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5854896b77-fj9jx_e23c4dbe-2592-470b-801f-c5212b30cb94 became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-ndjrj"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-vwqfw"

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-646cd44 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-646cd44

SuccessfulCreate

Created pod: jobset-controller-manager-646cd44-v6vmr

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-646cd44-v6vmr

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-646cd44-v6vmr

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-8lmz6

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8lmz6

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8lmz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5854896b77 from 1 to 0

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-8lmz6

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-5854896b77-fj9jx

Killing

Stopping container manager

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8lmz6

Created

Container created

opendatahub

replicaset-controller

maas-controller-5854896b77

SuccessfulDelete

Deleted pod: maas-controller-5854896b77-fj9jx

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8lmz6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-8lmz6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-jobset-operator

kubelet

jobset-controller-manager-646cd44-v6vmr

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.384s (4.384s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-646cd44-v6vmr

Started

Container started

openshift-jobset-operator

jobset-controller-manager-646cd44-v6vmr_1558ac58-9c2f-4b63-b423-94d086cffee2

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-646cd44-v6vmr_1558ac58-9c2f-4b63-b423-94d086cffee2 became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-646cd44-v6vmr

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-nfts6

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

Killing

Stopping container discovery

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-cvk8n

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

ProbeError

Readiness probe error: Get "http://10.134.0.17:8080/ready": dial tcp 10.134.0.17:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nfts6

Unhealthy

Readiness probe failed: Get "http://10.134.0.17:8080/ready": dial tcp 10.134.0.17:8080: connect: connection refused

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-v2v7m

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-h4phj

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-5md5f

opendatahub

kubelet

odh-model-controller-769875db56-v2v7m

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-h4phj

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

kserve-controller-manager-776cc66d47-cvk8n

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

multus

kserve-controller-manager-776cc66d47-cvk8n

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-5md5f

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-h4phj

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

opendatahub

multus

model-serving-api-75bd89fdfc-5md5f

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

opendatahub

multus

odh-model-controller-769875db56-v2v7m

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-5md5f

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-5md5f

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-5md5f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 3.741s (3.741s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-h4phj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 4.69s (4.691s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-h4phj

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-h4phj

Started

Container started

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 18.606s (18.606s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

Started

Container started

opendatahub

llmisvc-controller-manager-869d5dcc5d-h4phj_f556e69a-4412-466e-b307-5450c874216d

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-h4phj_f556e69a-4412-466e-b307-5450c874216d became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-lcsnr

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-cvk8n

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-v2v7m

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-v2v7m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 11.308s (11.308s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-cvk8n

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-v2v7m

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-cvk8n

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 12.333s (12.333s including waiting). Image size: 247676581 bytes.

opendatahub

kserve-controller-manager-776cc66d47-cvk8n_9435577b-fa9b-404d-9458-e8576480972c

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-cvk8n_9435577b-fa9b-404d-9458-e8576480972c became leader

opendatahub

maas-controller-6686485556-8hwrr_57156baa-89c5-4ad1-aa64-4d4e85f3d586

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6686485556-8hwrr_57156baa-89c5-4ad1-aa64-4d4e85f3d586 became leader

opendatahub

odh-model-controller-769875db56-v2v7m_5fcabbe3-baa0-44f1-b095-e66475116c60

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-v2v7m_5fcabbe3-baa0-44f1-b095-e66475116c60 became leader
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-664b5b9867 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-7cc78785cc from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7cc78785cc from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-7cc78785cc

SuccessfulDelete

Deleted pod: authorino-7cc78785cc-cdrj4

kuadrant-system

replicaset-controller

authorino-7cc78785cc

SuccessfulCreate

Created pod: authorino-7cc78785cc-cdrj4

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-pwkw5

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-pwkw5

kuadrant-system

kubelet

authorino-6f6944bcdd-pwkw5

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6f6944bcdd-pwkw5

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-664b5b9867

SuccessfulCreate

Created pod: authorino-664b5b9867-x4lkz

kuadrant-system

multus

authorino-664b5b9867-x4lkz

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-664b5b9867-x4lkz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6f6944bcdd-pwkw5

Started

Container started

kuadrant-system

kubelet

authorino-6f6944bcdd-pwkw5

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-pwkw5

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.906s (1.906s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-pwkw5

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-664b5b9867-x4lkz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.945s (1.945s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-664b5b9867-x4lkz

Started

Container started

kuadrant-system

kubelet

authorino-664b5b9867-x4lkz

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-pfp2l

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-pfp2l
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-ccqmz

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-ccqmz

opendatahub

multus

llmisvc-controller-manager-6466c554d8-ccqmz

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-ccqmz

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-ccqmz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 919ms (919ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-ccqmz

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-h4phj

Killing

Stopping container manager

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-h4phj

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-96g5j

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-96g5j

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-96g5j

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-96g5j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 3.019s (3.019s including waiting). Image size: 183979433 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-96g5j

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-96g5j

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-96g5j_f7af2079-9c3c-457c-89ff-0d6c64bf1560

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-96g5j_f7af2079-9c3c-457c-89ff-0d6c64bf1560 became leader
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-sdhwx

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-4qdkd

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-sdhwx

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-7b98bb678c-sdhwx

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-55fbbbf9dc-4qdkd

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4qdkd

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-sdhwx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-sdhwx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-sdhwx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.911s (2.911s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4qdkd

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4qdkd

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-4qdkd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.756s (3.756s including waiting). Image size: 125353963 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6bdf4bddbc from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-6bdf4bddbc

SuccessfulCreate

Created pod: ai-gateway-controller-6bdf4bddbc-hwvmh

opendatahub

kubelet

ai-gateway-controller-6bdf4bddbc-hwvmh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

llmisvc-controller-manager-6466c554d8-ccqmz_8bde3f16-519a-4417-8647-596680ab494f

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-ccqmz_8bde3f16-519a-4417-8647-596680ab494f became leader

opendatahub

multus

ai-gateway-controller-6bdf4bddbc-hwvmh

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6bdf4bddbc-hwvmh

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6bdf4bddbc-hwvmh

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6bdf4bddbc-hwvmh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 828ms (828ms including waiting). Image size: 183979433 bytes.
(x2)

opendatahub

kubelet

maas-controller-6686485556-8hwrr

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:9a530952aa600e4e49fa239e5159c9e763ee1bc413c99a7193c3f6842e7308b4"
(x2)

opendatahub

kubelet

maas-controller-6686485556-8hwrr

Created

Container created
(x2)

opendatahub

kubelet

maas-controller-6686485556-8hwrr

Started

Container started

opendatahub

kubelet

maas-controller-6686485556-8hwrr

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:9a530952aa600e4e49fa239e5159c9e763ee1bc413c99a7193c3f6842e7308b4" in 1.15s (1.15s including waiting). Image size: 200069638 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-96g5j

opendatahub

kubelet

ai-gateway-controller-7d85675f98-96g5j

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

maas-controller-6686485556-8hwrr_0b7ba0f8-ee1a-4fec-949d-cfec87670aaa

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6686485556-8hwrr_0b7ba0f8-ee1a-4fec-949d-cfec87670aaa became leader

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.345s (2.345s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-9z46n

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Error

Reconciliation failed: failed to reconcile networking: failed to reconcile HTTP routes: failed to reconcile HTTPRoute llm/e2e-distinct-2-simulated-kserve-route: failed to get defaults for v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route: Operation cannot be fulfilled on httproutes.gateway.networking.k8s.io "e2e-distinct-2-simulated-kserve-route": the object has been modified; please apply your changes to the latest version and try again

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-22fpx

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-22fpx

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-22fpx

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-22fpx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-22fpx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 612ms (612ms including waiting). Image size: 98346788 bytes.

opendatahub

ai-gateway-controller-6bdf4bddbc-hwvmh_467b4c6a-5c90-471c-8e57-7f14cf3201e8

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6bdf4bddbc-hwvmh_467b4c6a-5c90-471c-8e57-7f14cf3201e8 became leader

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-22fpx

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-tzkq2

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-tzkq2

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-tzkq2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-tzkq2

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.497s (1.497s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-6756s

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-tzkq2

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-tzkq2

Started

Container started

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-6756s

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-6756s

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-6756s

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-6756s

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-6756s

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 687ms (687ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 600ms (600ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b86d889

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-tqv66

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-tqv66

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-n4hh5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-cxmt4

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5df48fcc99 from 1 to 3

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-tqv66

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 580ms (580ms including waiting). Image size: 98346788 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-tqv66

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.967s (2.967s including waiting). Image size: 78208878 bytes.

llm

kubelet

echo-simulator-kserve-64b6f8f96c-tqv66

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-54rmh

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-tqv66

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 559ms (559ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 6.654s (6.654s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5df48fcc99 from 3 to 5

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-f6565

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-b8899

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 14.564s (14.564s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-f6565

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-b8899

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-f6565

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-f6565

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-f6565

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-f6565

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-f6565

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

kuadrant-system

replicaset-controller

authorino-5f87c44d4

SuccessfulCreate

Created pod: authorino-5f87c44d4-d554c

kuadrant-system

multus

authorino-5f87c44d4-d554c

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5f87c44d4-d554c

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5f87c44d4-d554c

Created

Container created

kuadrant-system

replicaset-controller

authorino-664b5b9867

SuccessfulDelete

Deleted pod: authorino-664b5b9867-x4lkz

kuadrant-system

kubelet

authorino-664b5b9867-x4lkz

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-5f87c44d4-d554c

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.783s (1.783s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5f87c44d4-d554c

Started

Container started
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-664b5b9867 from 1 to 0

openshift-ingress

gateway_labeler_controller

e2e-ait-4c476fff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4c476fff

openshift-ingress

gateway_labeler_controller

e2e-ait-48d2fd87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-48d2fd87

openshift-ingress

replicaset-controller

e2e-ait-48d2fd87-openshift-default-6dfc86c667

SuccessfulCreate

Created pod: e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

openshift-ingress

gateway_labeler_controller

e2e-migrate-f50c3be9-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f50c3be9-gw

openshift-ingress

deployment-controller

e2e-ait-48d2fd87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-48d2fd87-openshift-default-6dfc86c667 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-4c476fff-openshift-default-66776c5dbf

SuccessfulCreate

Created pod: e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

openshift-ingress

multus

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-f50c3be9-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665

SuccessfulCreate

Created pod: e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

openshift-ingress

multus

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-4c476fff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4c476fff-openshift-default-66776c5dbf from 0 to 1

openshift-ingress

multus

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-3145c214

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3145c214

openshift-ingress

deployment-controller

e2e-ait-3145c214-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3145c214-openshift-default-75d84f979f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-3145c214-openshift-default-75d84f979f

SuccessfulCreate

Created pod: e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

openshift-ingress

multus

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-48d2fd87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-48d2fd87-85bc8788c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-48d2fd87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-48d2fd87-6f9d558c from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-6800c12d-openshift-default-6b7978bf6f

SuccessfulCreate

Created pod: e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

openshift-ingress

deployment-controller

e2e-derive-6800c12d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6800c12d-openshift-default-6b7978bf6f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-6800c12d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6800c12d

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-48d2fd87-85bc8788c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt

openshift-ingress

multus

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-48d2fd87: serviceaccount "payload-processing-e2e-ait-48d2fd87" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh

openshift-ingress

multus

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-48d2fd87-85bc8788c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-48d2fd87-85bc8788c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-48d2fd87: serviceaccount "payload-processing-e2e-ait-48d2fd87" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f50c3be9-65879978c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f50c3be9-65879978c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f50c3be9: serviceaccount "payload-processing-e2e-migrate-f50c3be9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f50c3be9-65879978c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f50c3be9: serviceaccount "payload-processing-e2e-migrate-f50c3be9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f50c3be9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f50c3be9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f50c3be9-65879978c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4c476fff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4c476fff-78b48df47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4c476fff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4c476fff-74cfd5968c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4c476fff-78b48df47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4c476fff-78b48df47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4c476fff-78b48df47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4c476fff: serviceaccount "payload-processing-e2e-ait-4c476fff" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4c476fff-74cfd5968c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4c476fff-74cfd5968c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4c476fff: serviceaccount "payload-processing-e2e-ait-4c476fff" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4c476fff-74cfd5968c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.167s (3.167s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.103s (3.103s including waiting). Image size: 125353963 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3145c214

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3145c214-68b7bb6c77 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3145c214

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3145c214-745849f995 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3145c214-745849f995

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3145c214-745849f995

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3145c214-745849f995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3145c214: serviceaccount "payload-processing-e2e-ait-3145c214" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3145c214-68b7bb6c77

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3145c214-68b7bb6c77

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3145c214-68b7bb6c77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3145c214: serviceaccount "payload-processing-e2e-ait-3145c214" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.761s (2.761s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 862ms (862ms including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6800c12d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6800c12d-6875c7b86c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6800c12d-6875c7b86c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6800c12d-6875c7b86c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6800c12d: serviceaccount "payload-processing-e2e-derive-6800c12d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6800c12d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6800c12d-cc975bc59 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6800c12d-cc975bc59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6800c12d-cc975bc59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6800c12d-cc975bc59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6800c12d: serviceaccount "payload-processing-e2e-derive-6800c12d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6800c12d-6875c7b86c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5

openshift-ingress

multus

payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls

Created

Container created

openshift-ingress

multus

payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f50c3be9-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4c476fff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4c476fff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f50c3be9-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3145c214-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3145c214-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48d2fd87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4c476fff-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4c476fff-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f50c3be9-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f50c3be9-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48d2fd87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3145c214-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3145c214-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-4c476fff-74cfd5968c-htfq6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3145c214-68b7bb6c77-z99qb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4c476fff-78b48df47-stqpq

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.59:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48d2fd87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-48d2fd87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-a9c5b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-a9c5b3

openshift-ingress

kubelet

e2e-ait-3145c214-openshift-default-75d84f979f-tfls4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-48d2fd87-6f9d558c-8zvvh

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

openshift-ingress

kubelet

e2e-migrate-f50c3be9-gw-openshift-default-7c6b995665-ww4lc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-162191

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-162191

openshift-ingress

kubelet

payload-processing-e2e-ait-48d2fd87-85bc8788c7-6hsjt

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulCreate

Created pod: e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-f73b9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-f73b9f

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

openshift-ingress

multus

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 0 to 1

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-4c476fff-openshift-default-66776c5dbf-fwwdf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-a9c5b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-a9c5b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a9c5b3: serviceaccount "payload-processing-e2e-worker-w4-a9c5b3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a9c5b3: serviceaccount "payload-processing-e2e-worker-w4-a9c5b3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-162191

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-162191-7b85fb9855 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-162191: serviceaccount "payload-processing-e2e-worker-w0-162191" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-162191-7b85fb9855

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-162191-7b85fb9855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-162191: serviceaccount "payload-processing-e2e-worker-w0-162191" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-162191-7b85fb9855

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-162191

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-162191-594cffb5c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-6800c12d-6875c7b86c-snnq5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6800c12d-cc975bc59-8q8ls

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-f73b9f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-f73b9f-759767d4ff from 0 to 1

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-f73b9f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-865066

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-865066

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulCreate

Created pod: e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-f73b9f-759767d4ff

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-f73b9f-759767d4ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-f73b9f: serviceaccount "payload-processing-e2e-worker-w3-f73b9f" not found

openshift-ingress

deployment-controller

e2e-worker-w2-865066-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-865066-openshift-default-6559876c99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-f73b9f-759767d4ff

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-f73b9f: serviceaccount "payload-processing-e2e-worker-w3-f73b9f" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6800c12d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6800c12d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-48d2fd87-openshift-default-6dfc86c667-b7bm2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-865066-7f97465495

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-865066-b699f8cbf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-865066-b699f8cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-865066: serviceaccount "payload-processing-e2e-worker-w2-865066" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-865066

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-865066-b699f8cbf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-865066

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-865066-7f97465495 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-865066-7f97465495

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-865066-7f97465495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-865066: serviceaccount "payload-processing-e2e-worker-w2-865066" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-865066-b699f8cbf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6800c12d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-6800c12d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

Created

Container created

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-6800c12d-openshift-default-6b7978bf6f-tslfr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-c2c259

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-c2c259

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 0 to 1

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-c2c259: serviceaccount "payload-processing-e2e-worker-w1-c2c259" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-c2c259

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-c2c259-7f469b7bfc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-c2c259: serviceaccount "payload-processing-e2e-worker-w1-c2c259" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-c2c259

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": read tcp 10.132.0.2:42102->10.132.0.70:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": read tcp 10.132.0.2:42102->10.132.0.70:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulCreate

Created pod: e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

Started

Container started

openshift-ingress

multus

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-vjrbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n4hh5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-vjrbz

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-n4hh5

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-77d5dcc848

SuccessfulCreate

Created pod: payload-processing-external-model-77d5dcc848-45zm6

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-77d5dcc848 from 0 to 1
(x7)

models-as-a-service

replicaset-controller

payload-processing-external-model-77d5dcc848

FailedCreate

Error creating: pods "payload-processing-external-model-77d5dcc848-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

kubelet

payload-processing-external-model-77d5dcc848-45zm6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-77d5dcc848-45zm6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-77d5dcc848-45zm6

Started

Container started

models-as-a-service

multus

payload-processing-external-model-77d5dcc848-45zm6

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 2 to 4

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

models-as-a-service

multus

payload-processing-external-model-d44b46b89-qvj52

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-hq47j

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-c5zfm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-hq47j

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-jxfk6

models-as-a-service

kubelet

payload-processing-external-model-d44b46b89-qvj52

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-d44b46b89-qvj52

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-d44b46b89-qvj52

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-d44b46b89

SuccessfulCreate

Created pod: payload-processing-external-model-d44b46b89-qvj52

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-d44b46b89 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5df48fcc99 from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5df48fcc99 from 6 to 10

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-prwvm

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-flvv6

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-hdk28

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-5df48fcc99-prwvm

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-flvv6

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-d44b46b89

SuccessfulDelete

Deleted pod: payload-processing-external-model-d44b46b89-qvj52
(x6)

models-as-a-service

kubelet

payload-processing-external-model-d44b46b89-qvj52

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

multus

payload-processing-external-model-6698d5675d-kg28v

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-6698d5675d

SuccessfulCreate

Created pod: payload-processing-external-model-6698d5675d-kg28v

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-d44b46b89 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-d44b46b89-qvj52

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-kg28v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-kg28v

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-kg28v

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-kg28v

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-757c658c7b

SuccessfulCreate

Created pod: payload-processing-external-model-757c658c7b-pxlp8

models-as-a-service

replicaset-controller

payload-processing-external-model-6698d5675d

SuccessfulDelete

Deleted pod: payload-processing-external-model-6698d5675d-kg28v

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6698d5675d from 1 to 0

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-757c658c7b from 0 to 1
(x3)

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-kg28v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-757c658c7b-pxlp8

Started

Container started

models-as-a-service

multus

payload-processing-external-model-757c658c7b-pxlp8

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-757c658c7b-pxlp8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-757c658c7b-pxlp8

Created

Container created
(x6)

models-as-a-service

kubelet

payload-processing-external-model-77d5dcc848-45zm6

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-1fec6c1a0815" not found

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

ProbeError

Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Unhealthy

Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-77d5dcc848 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-77d5dcc848-45zm6

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-77d5dcc848

SuccessfulDelete

Deleted pod: payload-processing-external-model-77d5dcc848-45zm6

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 4 to 8

models-as-a-service

kubelet

payload-processing-external-model-77d5dcc848-45zm6

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.58:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

Created

Container created

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

Started

Container started

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 2 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 4 to 5

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-6698d5675d

SuccessfulCreate

Created pod: payload-processing-external-model-6698d5675d-tkzwb

models-as-a-service

multus

payload-processing-external-model-6698d5675d-tkzwb

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6698d5675d from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-tkzwb

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-tkzwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-tkzwb

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x2)

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-tkzwb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-757c658c7b-pxlp8

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-6698d5675d-tkzwb

Killing

Stopping container payload-processing

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

Unhealthy

Readiness probe failed: Get "https://10.132.0.53:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 2 to 4

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

Started

Container started

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

Created

Container created

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 8 to 10

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulCreate

Created pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Unhealthy

Startup probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

ProbeError

Startup probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

ProbeError

Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

Unhealthy

Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

Started

Container started

openshift-ingress

multus

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 5 to 6

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulCreate

Created pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 6 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

Created

Container created

openshift-ingress

multus

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

Unhealthy

Startup probe failed: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

Unhealthy

Startup probe failed: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

ProbeError

Startup probe error: Get "http://10.132.0.116:15021/healthz/ready": dial tcp 10.132.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

ProbeError

Startup probe error: Get "http://10.132.0.115:15021/healthz/ready": dial tcp 10.132.0.115:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulCreate

Created pod: e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

Started

Container started

openshift-ingress

multus

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-mt-078e0d65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-078e0d65

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Unhealthy

Readiness probe failed: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

ProbeError

Readiness probe error: Get "http://10.132.0.105:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-67x52

Unhealthy

Readiness probe failed: Get "https://10.132.0.53:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

openshift-ingress

deployment-controller

e2e-mt-078e0d65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-078e0d65-openshift-default-66569d64b9 from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes
(x10)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-078e0d65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-078e0d65-d7cb67597 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 3 to 5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-078e0d65: serviceaccount "payload-processing-e2e-mt-078e0d65" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulCreate

Created pod: e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-078e0d65-d7cb67597

FailedCreate

Error creating: pods "payload-processing-e2e-mt-078e0d65-d7cb67597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-078e0d65: serviceaccount "payload-processing-e2e-mt-078e0d65" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-078e0d65-d7cb67597

SuccessfulCreate

Created pod: payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-078e0d65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-078e0d65-58c4f98db7 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

Created

Container created

openshift-ingress

multus

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulCreate

Created pod: e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

Created

Container created

openshift-ingress

deployment-controller

e2e-api-a-182e51-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-182e51-openshift-default-64c5d5457c from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-182e51-openshift-default-64c5d5457c

SuccessfulCreate

Created pod: e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

openshift-ingress

gateway_labeler_controller

e2e-api-a-182e51

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-182e51

openshift-ingress

multus

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

ProbeError

Startup probe error: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

Unhealthy

Startup probe failed: Get "http://10.132.0.123:15021/healthz/ready": dial tcp 10.132.0.123:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-182e51-9b9bfcc67

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-182e51: serviceaccount "payload-processing-e2e-api-a-182e51" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-182e51

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-182e51-7dc55f6df5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-182e51-9b9bfcc67

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-182e51-9b9bfcc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-182e51: serviceaccount "payload-processing-e2e-api-a-182e51" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-182e51

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-182e51-9b9bfcc67 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-k295k

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-k295k

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k295k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k295k

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k295k

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k295k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 7.735s (7.735s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k295k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k295k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-aab51f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-aab51f

openshift-ingress

deployment-controller

e2e-api-a-aab51f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-aab51f-openshift-default-8589c8cbbf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-aab51f-openshift-default-8589c8cbbf

SuccessfulCreate

Created pod: e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

openshift-ingress

multus

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulCreate

Created pod: e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-865066-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-865066-openshift-default-6559876c99 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

Created

Container created

openshift-ingress

multus

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-aab51f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-aab51f-6b57bcbcb7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-aab51f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-aab51f-6b57bcbcb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-aab51f-6b57bcbcb7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-aab51f-6b57bcbcb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-aab51f: serviceaccount "payload-processing-e2e-api-a-aab51f" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-aab51f: serviceaccount "payload-processing-e2e-api-a-aab51f" not found

openshift-ingress

multus

payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulCreate

Created pod: e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

openshift-ingress

deployment-controller

e2e-worker-w2-865066-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-865066-openshift-default-6559876c99 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

Created

Container created

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Unhealthy

Readiness probe failed: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

ProbeError

Readiness probe error: Get "http://10.132.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

ProbeError

Readiness probe error: Get "http://10.132.0.122:15021/healthz/ready": read tcp 10.132.0.2:57036->10.132.0.122:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

Unhealthy

Readiness probe failed: Get "http://10.132.0.122:15021/healthz/ready": read tcp 10.132.0.2:57036->10.132.0.122:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Unhealthy

Startup probe failed: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

ProbeError

Startup probe error: Get "http://10.132.0.124:15021/healthz/ready": dial tcp 10.132.0.124:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-182e51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-182e51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-b-3344e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3344e8

openshift-ingress

deployment-controller

e2e-api-b-3344e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3344e8-openshift-default-7cd764b965 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-3344e8-openshift-default-7cd764b965

SuccessfulCreate

Created pod: e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

openshift-ingress

multus

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3344e8-6c5b66759f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3344e8: serviceaccount "payload-processing-e2e-api-b-3344e8" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3344e8-6c5b66759f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3344e8-6c5b66759f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3344e8: serviceaccount "payload-processing-e2e-api-b-3344e8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3344e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3344e8-7b57f5659f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3344e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3344e8-6c5b66759f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-182e51-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-182e51-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-078e0d65-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-078e0d65-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulCreate

Created pod: e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulCreate

Created pod: e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

openshift-ingress

deployment-controller

e2e-worker-w2-865066-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-865066-openshift-default-6559876c99 from 3 to 5
(x5)

openshift-ingress

kubelet

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

Started

Container started

openshift-ingress

multus

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

Unhealthy

Startup probe failed: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

ProbeError

Startup probe error: Get "http://10.132.0.130:15021/healthz/ready": dial tcp 10.132.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-aab51f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-aab51f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-api-a-78dad9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-78dad9

openshift-ingress

multus

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-78dad9-openshift-default-b98fc5575

SuccessfulCreate

Created pod: e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

openshift-ingress

deployment-controller

e2e-api-a-78dad9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-78dad9-openshift-default-b98fc5575 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-6dd36b-openshift-default-5d78fccfbf

SuccessfulCreate

Created pod: e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

openshift-ingress

gateway_labeler_controller

e2e-api-b-6dd36b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6dd36b

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-78dad9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-78dad9-7c985bb45 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-78dad9-577bbf676c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-78dad9-577bbf676c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-78dad9: serviceaccount "payload-processing-e2e-api-a-78dad9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-78dad9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-78dad9-577bbf676c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-78dad9-577bbf676c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-78dad9-7c985bb45

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-78dad9-7c985bb45-49b92
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-78dad9-7c985bb45

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-78dad9-7c985bb45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-78dad9: serviceaccount "payload-processing-e2e-api-a-78dad9" not found

openshift-ingress

deployment-controller

e2e-api-b-6dd36b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6dd36b-openshift-default-5d78fccfbf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-78dad9-7c985bb45-49b92

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-78dad9-7c985bb45-49b92

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-78dad9-7c985bb45-49b92

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-78dad9-7c985bb45-49b92

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-aab51f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-aab51f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6dd36b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6dd36b-7f576577d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6dd36b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6dd36b: serviceaccount "payload-processing-e2e-api-b-6dd36b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6dd36b: serviceaccount "payload-processing-e2e-api-b-6dd36b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-4adf4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-4adf4c

openshift-ingress

deployment-controller

e2e-shared-a-w2-4adf4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855

SuccessfulCreate

Created pod: e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

openshift-ingress

multus

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-4adf4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-4adf4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4adf4c: serviceaccount "payload-processing-e2e-shared-a-w2-4adf4c" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4adf4c: serviceaccount "payload-processing-e2e-shared-a-w2-4adf4c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

Started

Container started

openshift-ingress

replicaset-controller

e2e-api-b-3344e8-openshift-default-7cd764b965

SuccessfulCreate

Created pod: e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

openshift-ingress

deployment-controller

e2e-api-b-3344e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3344e8-openshift-default-7cd764b965 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3344e8-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

Started

Container started

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

Created

Container created

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

ProbeError

Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": read tcp 10.134.0.2:42570->10.134.0.88:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Created

Container created

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Unhealthy

Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": read tcp 10.134.0.2:42570->10.134.0.88:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3344e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3344e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

test-curl-7422-5e957c

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7422-5e957c

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7422-5e957c

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.546s (1.546s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7422-5e957c

Started

Container started

opendatahub

kubelet

test-curl-7422-5e957c

Created

Container created

opendatahub

kubelet

test-curl-7422-5e957c

Killing

Stopping container test-curl-7422-5e957c
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3344e8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-3344e8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-182e51-9b9bfcc67-qjg79

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-182e51-7dc55f6df5-2s6gp

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-crnqm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-vww9w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-78dad9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-78dad9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6dd36b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6dd36b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

Started

Container started

openshift-ingress

deployment-controller

e2e-api-b-dc980b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-dc980b-openshift-default-5bd94f7b59 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-dc980b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-dc980b

openshift-ingress

replicaset-controller

e2e-api-b-dc980b-openshift-default-5bd94f7b59

SuccessfulCreate

Created pod: e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

openshift-ingress

multus

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4adf4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4adf4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6dd36b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-6dd36b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-dc980b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-dc980b-7cd65fc645 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dc980b-7cd65fc645

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-dc980b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-dc980b-74d76b8695 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dc980b-74d76b8695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-dc980b-74d76b8695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dc980b: serviceaccount "payload-processing-e2e-api-b-dc980b" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dc980b-7cd65fc645

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-dc980b-7cd65fc645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dc980b: serviceaccount "payload-processing-e2e-api-b-dc980b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dc980b-74d76b8695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf

openshift-ingress

multus

payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-fb1c1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-fb1c1f

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9

SuccessfulCreate

Created pod: e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

openshift-ingress

multus

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-fb1c1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4adf4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4adf4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f: serviceaccount "payload-processing-e2e-shared-b-w2-fb1c1f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-fb1c1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-fb1c1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f: serviceaccount "payload-processing-e2e-shared-b-w2-fb1c1f" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 5 to 4

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulDelete

Deleted pod: e2e-worker-w0-162191-openshift-default-699bc96769-gvz2q

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-l2v64

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-078e0d65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-078e0d65-d7cb67597 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-078e0d65: serviceaccount "payload-processing-e2e-mt-078e0d65" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-078e0d65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-078e0d65-58c4f98db7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-078e0d65-d7cb67597

FailedCreate

Error creating: pods "payload-processing-e2e-mt-078e0d65-d7cb67597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-078e0d65: serviceaccount "payload-processing-e2e-mt-078e0d65" not found

openshift-ingress

multus

payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 10 to 9

openshift-ingress

multus

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-078e0d65-d7cb67597

SuccessfulCreate

Created pod: payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-htv6r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz

Started

Container started

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf

Started

Container started

openshift-ingress

kubelet

e2e-api-a-182e51-openshift-default-64c5d5457c-w4k9c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulDelete

Deleted pod: e2e-worker-w0-162191-openshift-default-699bc96769-z7jw4
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vnhhv

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 8 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-xt8wl

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 9 to 6

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-gkd97

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 10 to 5

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-wwbpk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-9r9fd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-fb1c1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-fb1c1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-f75fh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

ProbeError

Readiness probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8c95l

Unhealthy

Readiness probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-v5x4v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc
(x2)

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

ProbeError

Readiness probe error: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-w6dgc

Unhealthy

Readiness probe failed: Get "http://10.132.0.102:15021/healthz/ready": dial tcp 10.132.0.102:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-dc980b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-dc980b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-aab51f-openshift-default-8589c8cbbf-l4hvr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-dc980b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-dc980b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-6dd36b-5b4bb5b5dc-hklbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-fb1c1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-fb1c1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-78dad9-577bbf676c-4m7w7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-78dad9-7c985bb45-49b92

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-078e0d65-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-078e0d65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-078e0d65-openshift-default-66569d64b9 from 1 to 4

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

Started

Container started

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

Created

Container created

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

Started

Container started

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

Created

Container created

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

Started

Container started

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

Created

Container created

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

Unhealthy

Startup probe failed: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

ProbeError

Startup probe error: Get "http://10.132.0.142:15021/healthz/ready": dial tcp 10.132.0.142:15021: connect: connection refused body:

opendatahub

multus

test-curl-7422-e1bc22

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7422-e1bc22

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7422-e1bc22

Created

Container created

opendatahub

kubelet

test-curl-7422-e1bc22

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.726s (2.726s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7422-e1bc22

Started

Container started

openshift-ingress

deployment-controller

e2e-mt-078e0d65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-078e0d65-openshift-default-66569d64b9 from 4 to 8

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-078e0d65-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

Created

Container created

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

Created

Container created

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

Started

Container started

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

Created

Container created

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

Started

Container started

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

Started

Container started

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

Created

Container created

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

Started

Container started

opendatahub

kubelet

test-curl-7422-e1bc22

Killing

Stopping container test-curl-7422-e1bc22
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-c7tcr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-3344e8-openshift-default-7cd764b965-n5xkx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-157fed-openshift-default-5975bb79d7

SuccessfulCreate

Created pod: e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-157fed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-157fed

openshift-ingress

deployment-controller

e2e-ipp-a-157fed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-157fed-openshift-default-5975bb79d7 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulDelete

Deleted pod: e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

openshift-ingress

deployment-controller

e2e-worker-w2-865066-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-865066-openshift-default-6559876c99 from 5 to 3

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-2lt96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulDelete

Deleted pod: e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-078e0d65-58c4f98db7-b4sxf

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-mt-078e0d65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-078e0d65-openshift-default-66569d64b9 from 8 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-078e0d65-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

replicaset-controller

e2e-mt-078e0d65-openshift-default-66569d64b9

SuccessfulCreate

Created pod: e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

openshift-ingress

kubelet

payload-processing-e2e-mt-078e0d65-d7cb67597-qmwmz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

Created

Container created

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

Started

Container started

openshift-ingress

multus

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-157fed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-157fed-76f89d5c85 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-157fed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-157fed-76f89d5c85

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-157fed-76f89d5c85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-157fed: serviceaccount "payload-processing-e2e-ipp-a-157fed" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-157fed-76f89d5c85

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-157fed: serviceaccount "payload-processing-e2e-ipp-a-157fed" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-b5x68

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bs7hb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulDelete

Deleted pod: e2e-worker-w0-162191-openshift-default-699bc96769-thrjk

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-hcndn

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5df48fcc99 from 10 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-prwvm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-jxfk6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-c5zfm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-n8gdm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-b8899

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-b8899

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-c5zfm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-jxfk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-n8gdm

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-prwvm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-78dad9-openshift-default-b98fc5575-m4nsv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-5b71cd-openshift-default-77b9696d87

SuccessfulCreate

Created pod: e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

openshift-ingress

deployment-controller

e2e-ipp-a-5b71cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-5b71cd-openshift-default-77b9696d87 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-5b71cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-5b71cd

openshift-ingress

multus

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc980b-7cd65fc645-qp2nb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc980b-74d76b8695-896gf

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5b71cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5b71cd-7848f894d9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5b71cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5b71cd-566999975 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5b71cd-566999975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5b71cd-566999975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5b71cd: serviceaccount "payload-processing-e2e-ipp-a-5b71cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5b71cd-7848f894d9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5b71cd-7848f894d9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5b71cd-7848f894d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5b71cd: serviceaccount "payload-processing-e2e-ipp-a-5b71cd" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5b71cd-566999975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk

Created

Container created

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-xvckz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-k49wk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-whgbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-gdwpk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-mk9lj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-078e0d65-openshift-default-66569d64b9-5vq8c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-86b4b4bfff-ch474

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-76f89d5c85-5q8z6

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-157fed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-157fed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-plhn5

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-p79qx

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-p79qx

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-zhpnb

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-plhn5

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-j94nh

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-j94nh

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5df48fcc99 from 5 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-plhn5

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-plhn5

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-plhn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-p79qx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-p79qx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-p79qx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-157fed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-157fed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

ProbeError

Startup probe error: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

Unhealthy

Startup probe failed: Get "http://10.134.0.115:15021/healthz/ready": dial tcp 10.134.0.115:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-p79qx

ProbeError

Startup probe error: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

Unhealthy

Startup probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-p79qx

Unhealthy

Startup probe failed: Get "http://10.134.0.116:15021/healthz/ready": dial tcp 10.134.0.116:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-plhn5

Unhealthy

Startup probe failed: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-plhn5

ProbeError

Startup probe error: Get "http://10.132.0.149:15021/healthz/ready": dial tcp 10.132.0.149:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

ProbeError

Startup probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-157fed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-157fed-86b5f678fd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-157fed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-157fed-86b5f678fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-157fed-86b5f678fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-157fed: serviceaccount "payload-processing-e2e-ipp-a-157fed" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-157fed: serviceaccount "payload-processing-e2e-ipp-a-157fed" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-157fed-86b5f678fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-dc980b-openshift-default-5bd94f7b59-lxmd5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-131718

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-131718

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.185s (3.185s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.49s (2.49s including waiting). Image size: 166620835 bytes.

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5b71cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-ipp-a-131718-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-131718-openshift-default-567c94bd9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-131718-openshift-default-567c94bd9

SuccessfulCreate

Created pod: e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

openshift-ingress

multus

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5b71cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-131718-99f467587

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-131718-99f467587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-131718: serviceaccount "payload-processing-e2e-ipp-a-131718" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-865066-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-865066-openshift-default-6559876c99 from 3 to 2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-131718

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-131718-99f467587 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-131718: serviceaccount "payload-processing-e2e-ipp-a-131718" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-131718

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-131718-7cccb557f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulDelete

Deleted pod: e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-131718-99f467587

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-131718-99f467587-47lnx

openshift-ingress

multus

payload-processing-e2e-ipp-a-131718-99f467587-47lnx

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-99f467587-47lnx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-99f467587-47lnx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-99f467587-47lnx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5df48fcc99-d9tgt

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5df48fcc99 from 9 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-535e84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-535e84

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-7848f894d9-h8qqk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-566999975-cxrq7

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-535e84-openshift-default-d99999c69

SuccessfulCreate

Created pod: e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

openshift-ingress

deployment-controller

e2e-ipp-b-535e84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-535e84-openshift-default-d99999c69 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 4 to 2

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2d683e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2d683e

openshift-ingress

deployment-controller

e2e-ipp-b-2d683e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2d683e-openshift-default-59466dfd5c from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-b-2d683e-openshift-default-59466dfd5c

SuccessfulCreate

Created pod: e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-bj4xb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

Unhealthy

Startup probe failed: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-vtwzq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

ProbeError

Startup probe error: Get "http://10.132.0.151:15021/healthz/ready": dial tcp 10.132.0.151:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 4 to 2

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-535e84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-535e84-747749d5bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-j269p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-535e84: serviceaccount "payload-processing-e2e-ipp-b-535e84" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-535e84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-535e84-557577dbbc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-535e84-557577dbbc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-535e84-557577dbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-535e84: serviceaccount "payload-processing-e2e-ipp-b-535e84" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-535e84-557577dbbc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-fcpmx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d683e: serviceaccount "payload-processing-e2e-ipp-b-2d683e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2d683e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2d683e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2d683e-65cd844475 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d683e-65cd844475

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2d683e-65cd844475

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2d683e-65cd844475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2d683e: serviceaccount "payload-processing-e2e-ipp-b-2d683e" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5b71cd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-5b71cd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d683e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d683e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5b71cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5b71cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5b71cd: serviceaccount "payload-processing-e2e-ipp-a-5b71cd" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5b71cd: serviceaccount "payload-processing-e2e-ipp-a-5b71cd" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.566s (2.566s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.957s (1.957s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

ProbeError

Startup probe error: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

Unhealthy

Startup probe failed: Get "http://10.132.0.150:15021/healthz/ready": dial tcp 10.132.0.150:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-131718-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-131718-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

ProbeError

Readiness probe error: Get "http://10.133.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Unhealthy

Readiness probe failed: Get "http://10.133.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-535e84-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-535e84-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3a348f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3a348f

openshift-ingress

deployment-controller

e2e-ipp-a-3a348f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3a348f-openshift-default-7b46745bd5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-3a348f-openshift-default-7b46745bd5

SuccessfulCreate

Created pod: e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

openshift-ingress

multus

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-131718-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3a348f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3a348f-6f548bcf5 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-131718-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3a348f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3a348f-6f548bcf5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3a348f-6f548bcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3a348f: serviceaccount "payload-processing-e2e-ipp-a-3a348f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3a348f-6f548bcf5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3a348f: serviceaccount "payload-processing-e2e-ipp-a-3a348f" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d683e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-2d683e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-7cccb557f5-hw97t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-99f467587-47lnx

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-535e84-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-535e84-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-a-601a4b-openshift-default-665b98cf95

SuccessfulCreate

Created pod: e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-601a4b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-601a4b

openshift-ingress

deployment-controller

e2e-ipp-a-601a4b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-601a4b-openshift-default-665b98cf95 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-162191-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-162191-openshift-default-699bc96769

SuccessfulDelete

Deleted pod: e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-9tw2x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-162191-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-162191-openshift-default-699bc96769 from 2 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-601a4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-601a4b-795cd4d4bf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-601a4b: serviceaccount "payload-processing-e2e-ipp-a-601a4b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-601a4b: serviceaccount "payload-processing-e2e-ipp-a-601a4b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-601a4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-535e84-747749d5bc-vjz7p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-535e84-557577dbbc-xrxhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2d683e-554b76f66c-9jxvw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2d683e-65cd844475-hps68

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-601a4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-601a4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-157fed-86b5f678fd-tkcn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-157fed-65fb76cb59-4jzbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5b71cd-6f5b6b687d-lxzrr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5b71cd-cd8d5c94c-2fg4z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-157fed-openshift-default-5975bb79d7-d5t8n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-5b71cd-openshift-default-77b9696d87-q8cdl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-131718

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-131718-5b57fc766d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-131718

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-131718-549d9dc579 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-131718-5b57fc766d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-131718-5b57fc766d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-131718: serviceaccount "payload-processing-e2e-ipp-a-131718" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-131718-549d9dc579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-131718-549d9dc579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-131718-549d9dc579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-131718: serviceaccount "payload-processing-e2e-ipp-a-131718" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-131718-5b57fc766d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-72snh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w2-865066-openshift-default-6559876c99

SuccessfulDelete

Deleted pod: e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-865066-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w2-865066-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-865066-openshift-default-6559876c99 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-a7b5f0-openshift-default-9994757f5

SuccessfulCreate

Created pod: e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-jx2s5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a7b5f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a7b5f0

openshift-ingress

deployment-controller

e2e-ipp-b-a7b5f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a7b5f0-openshift-default-9994757f5 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-4c2a66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-4c2a66

openshift-ingress

replicaset-controller

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f

SuccessfulCreate

Created pod: e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

openshift-ingress

deployment-controller

e2e-praxis-a-4c2a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f from 0 to 1

openshift-ingress

multus

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a7b5f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a7b5f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a7b5f0: serviceaccount "payload-processing-e2e-ipp-b-a7b5f0" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a7b5f0: serviceaccount "payload-processing-e2e-ipp-b-a7b5f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4c2a66: serviceaccount "payload-processing-e2e-praxis-a-4c2a66" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-4c2a66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-4c2a66-556f69bb59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-4c2a66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4c2a66-556f69bb59

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-4c2a66-556f69bb59

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-4c2a66-556f69bb59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-4c2a66: serviceaccount "payload-processing-e2e-praxis-a-4c2a66" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-praxis-a-e7c9be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-e7c9be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-e7c9be

openshift-ingress

replicaset-controller

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7

SuccessfulCreate

Created pod: e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

openshift-ingress

multus

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

Unhealthy

Readiness probe failed: Get "http://10.132.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

ProbeError

Readiness probe error: Get "http://10.132.0.166:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

Started

Container started
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e7c9be: serviceaccount "payload-processing-e2e-praxis-a-e7c9be" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e7c9be-565c8b6885

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-e7c9be-565c8b6885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e7c9be: serviceaccount "payload-processing-e2e-praxis-a-e7c9be" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-e7c9be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-e7c9be-565c8b6885 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-e7c9be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3a348f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3a348f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e7c9be-565c8b6885

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-6f548bcf5-qc8b7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-601a4b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-601a4b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3a348f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-3a348f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e7c9be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e7c9be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf

SuccessfulCreate

Created pod: e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0ee0f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0ee0f8

openshift-ingress

deployment-controller

e2e-ipp-b-0ee0f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf from 0 to 1

openshift-ingress

multus

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8: serviceaccount "payload-processing-e2e-ipp-b-0ee0f8" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8: serviceaccount "payload-processing-e2e-ipp-b-0ee0f8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0ee0f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0ee0f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

ProbeError

Startup probe error: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

Unhealthy

Startup probe failed: Get "http://10.132.0.171:15021/healthz/ready": dial tcp 10.132.0.171:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3a348f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3a348f-57dd9b44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3a348f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3a348f: serviceaccount "payload-processing-e2e-ipp-a-3a348f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3a348f-57dd9b44

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3a348f-57dd9b44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3a348f: serviceaccount "payload-processing-e2e-ipp-a-3a348f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3a348f-57dd9b44

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67

openshift-ingress

multus

payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a7b5f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a7b5f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

ProbeError

Startup probe error: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

Unhealthy

Startup probe failed: Get "http://10.134.0.137:15021/healthz/ready": dial tcp 10.134.0.137:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0882f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0882f4

openshift-ingress

replicaset-controller

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f

SuccessfulCreate

Created pod: e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

openshift-ingress

deployment-controller

e2e-ipp-b-0882f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0882f4-openshift-default-86d8dcd84f from 0 to 1

openshift-ingress

multus

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a7b5f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a7b5f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-601a4b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-601a4b-5856bb8598 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-601a4b-5856bb8598

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-601a4b-5856bb8598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-601a4b: serviceaccount "payload-processing-e2e-ipp-a-601a4b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-601a4b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-601a4b-64569c499f from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-601a4b: serviceaccount "payload-processing-e2e-ipp-a-601a4b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-601a4b-5856bb8598

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0882f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0882f4-668c846c47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0882f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0882f4-668c846c47

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0882f4-668c846c47

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0882f4-668c846c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0882f4: serviceaccount "payload-processing-e2e-ipp-b-0882f4" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0882f4: serviceaccount "payload-processing-e2e-ipp-b-0882f4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-59d45f45c7-bbvls

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-77d988f4c-pks7b

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e7c9be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e7c9be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-2afc0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-2afc0d

openshift-ingress

deployment-controller

e2e-praxis-b-2afc0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7

SuccessfulCreate

Created pod: e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

openshift-ingress

multus

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5df48fcc99 from 10 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-plhn5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-plhn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-d9tgt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-flvv6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-f6565

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-d9tgt

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-f6565

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-flvv6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2afc0d: serviceaccount "payload-processing-e2e-praxis-b-2afc0d" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-2afc0d: serviceaccount "payload-processing-e2e-praxis-b-2afc0d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-2afc0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-2afc0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-2afc0d-7577c5bc65 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

ProbeError

Startup probe error: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

Unhealthy

Startup probe failed: Get "http://10.132.0.172:15021/healthz/ready": dial tcp 10.132.0.172:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

ProbeError

Startup probe error: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

Unhealthy

Startup probe failed: Get "http://10.132.0.173:15021/healthz/ready": dial tcp 10.132.0.173:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-862ad1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-862ad1

openshift-ingress

deployment-controller

e2e-praxis-b-862ad1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-862ad1-openshift-default-6fb69d8785 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-862ad1-openshift-default-6fb69d8785

SuccessfulCreate

Created pod: e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2afc0d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2afc0d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-862ad1-6ff648ccc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-862ad1-6ff648ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-862ad1: serviceaccount "payload-processing-e2e-praxis-b-862ad1" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-862ad1: serviceaccount "payload-processing-e2e-praxis-b-862ad1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-862ad1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-862ad1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-862ad1-6ff648ccc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-862ad1-6ff648ccc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4c2a66-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-4c2a66-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0ee0f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0ee0f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a7b5f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a7b5f0-75cf8487d from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a7b5f0: serviceaccount "payload-processing-e2e-ipp-b-a7b5f0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a7b5f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a7b5f0: serviceaccount "payload-processing-e2e-ipp-b-a7b5f0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

ProbeError

Startup probe error: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

Unhealthy

Startup probe failed: Get "http://10.132.0.174:15021/healthz/ready": dial tcp 10.132.0.174:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0882f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0882f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0882f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0882f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

ProbeError

Readiness probe error: Get "http://10.132.0.176:15021/healthz/ready": read tcp 10.132.0.2:45632->10.132.0.176:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Unhealthy

Readiness probe failed: Get "http://10.132.0.176:15021/healthz/ready": read tcp 10.132.0.2:45632->10.132.0.176:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-131718-549d9dc579-ks9kv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-131718-5b57fc766d-mnzkv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-131718-openshift-default-567c94bd9-f2gnt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-601a4b-5856bb8598-866dw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-601a4b-64569c499f-wchrh

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2afc0d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-2afc0d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-601a4b-openshift-default-665b98cf95-frdcl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-c2c259-openshift-default-6465f87cb7

SuccessfulDelete

Deleted pod: e2e-worker-w1-c2c259-openshift-default-6465f87cb7-v88r6

openshift-ingress

deployment-controller

e2e-worker-w1-c2c259-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-c2c259-openshift-default-6465f87cb7 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-c2c259-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x2)

openshift-ingress

kubelet

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f

SuccessfulDelete

Deleted pod: e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr
(x4)

openshift-ingress

deployment-controller

e2e-worker-w4-a9c5b3-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f from 2 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-a9c5b3-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-f73b9f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f from 2 to 1

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-f73b9f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f

SuccessfulDelete

Deleted pod: e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-c8jlr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

Unhealthy

Startup probe failed: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

ProbeError

Startup probe error: Get "http://10.132.0.179:15021/healthz/ready": dial tcp 10.132.0.179:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-k295k

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-k295k
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-862ad1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-862ad1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-zhpnb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5df48fcc99 from 6 to 5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-862ad1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-862ad1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-4c2a66-54d499db4c-z5wnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-4c2a66-556f69bb59-kdwrd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3a348f-d59b57b75-9sl2m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3a348f-57dd9b44-dbq67

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e7c9be-565c8b6885-2x6hd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e7c9be-6f96b9fbff-8w9d8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-3a348f-openshift-default-7b46745bd5-r5knq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a7b5f0-555d48bbc9-bdf57

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a7b5f0-75cf8487d-g24x6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a7b5f0-openshift-default-9994757f5-z76cq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-550b8a-openshift-default-8c677bf7

SuccessfulCreate

Created pod: e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

openshift-ingress

deployment-controller

e2e-praxis-a-550b8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-550b8a-openshift-default-8c677bf7 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-550b8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-550b8a

openshift-ingress

multus

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-0ee0f8-openshift-default-5bbfd67bdf-qbzjs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-ad9e22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-ad9e22

openshift-ingress

kubelet

e2e-praxis-a-4c2a66-openshift-default-54ffd7ff4f-ddnmf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589

SuccessfulCreate

Created pod: e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

openshift-ingress

deployment-controller

e2e-praxis-a-ad9e22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-ad9e22-openshift-default-6dfdc6589 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-550b8a-76f96777b5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-550b8a-76f96777b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-550b8a: serviceaccount "payload-processing-e2e-praxis-a-550b8a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-550b8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-550b8a-76f96777b5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-550b8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-550b8a: serviceaccount "payload-processing-e2e-praxis-a-550b8a" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-550b8a-76f96777b5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-ad9e22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ad9e22: serviceaccount "payload-processing-e2e-praxis-a-ad9e22" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-ad9e22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-ad9e22: serviceaccount "payload-processing-e2e-praxis-a-ad9e22" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-2afc0d-85d8cdf78c-sr5q2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-2afc0d-7577c5bc65-8jqqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-e7c9be-openshift-default-6bbdf499f7-rkh96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-862ad1-6ff648ccc-6kcvk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-cxmt4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hq47j

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-1cdd1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-1cdd1d
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5df48fcc99 from 5 to 3

openshift-ingress

replicaset-controller

e2e-praxis-a-1cdd1d-openshift-default-784c85765c

SuccessfulCreate

Created pod: e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

openshift-ingress

deployment-controller

e2e-praxis-a-1cdd1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1cdd1d-openshift-default-784c85765c from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-0882f4-openshift-default-86d8dcd84f-bhd8l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-1cdd1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1cdd1d: serviceaccount "payload-processing-e2e-praxis-a-1cdd1d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-1cdd1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1cdd1d: serviceaccount "payload-processing-e2e-praxis-a-1cdd1d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-2afc0d-openshift-default-75cd6c49f7-hmr84

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-862ad1-openshift-default-6fb69d8785-8m2s9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ad9e22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-f73b9f-759767d4ff-n5q8t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ad9e22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-f73b9f-5499d45f9-7n84p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-804014

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-804014

openshift-ingress

replicaset-controller

e2e-praxis-b-804014-openshift-default-76dc5db6b9

SuccessfulCreate

Created pod: e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

openshift-ingress

deployment-controller

e2e-praxis-b-804014-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-804014-openshift-default-76dc5db6b9 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ad9e22-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-ad9e22-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-804014

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-804014-f8fb8f799 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-804014-6d666759c5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-804014-6d666759c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-804014: serviceaccount "payload-processing-e2e-praxis-b-804014" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-804014: serviceaccount "payload-processing-e2e-praxis-b-804014" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-804014

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-804014-6d666759c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-804014-6d666759c5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm

openshift-ingress

multus

payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-550b8a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-550b8a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-162191-594cffb5c9-9ngds

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-162191-7b85fb9855-mfgf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f7545f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f7545f

openshift-ingress

deployment-controller

e2e-praxis-b-f7545f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f7545f-openshift-default-6846cb4869 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-f7545f-openshift-default-6846cb4869

SuccessfulCreate

Created pod: e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f7545f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f7545f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f7545f-88c6646c5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f7545f: serviceaccount "payload-processing-e2e-praxis-b-f7545f" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f7545f-88c6646c5

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f7545f-88c6646c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f7545f: serviceaccount "payload-processing-e2e-praxis-b-f7545f" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1cdd1d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1cdd1d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f7545f-88c6646c5

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1cdd1d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1cdd1d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f7545f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f7545f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-b-b8319b-openshift-default-567b77d49

SuccessfulCreate

Created pod: e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

openshift-ingress

deployment-controller

e2e-praxis-b-b8319b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-b8319b-openshift-default-567b77d49 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-b8319b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-b8319b

openshift-ingress

multus

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-b8319b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-b8319b-7c8cd46599 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-b8319b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b8319b: serviceaccount "payload-processing-e2e-praxis-b-b8319b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b8319b-7c8cd46599

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-b8319b-7c8cd46599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-b8319b: serviceaccount "payload-processing-e2e-praxis-b-b8319b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-b8319b-7c8cd46599

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-162191-openshift-default-699bc96769-jnmsd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-p92hj

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

ProbeError

Startup probe error: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

Unhealthy

Startup probe failed: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

ProbeError

Startup probe error: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

Unhealthy

Startup probe failed: Get "http://10.132.0.202:15021/healthz/ready": dial tcp 10.132.0.202:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-804014-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-804014-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-550b8a-76f96777b5-rkbnt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-550b8a-64cd4c79f-z244x

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f7545f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f7545f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8319b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8319b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

Unhealthy

Startup probe failed: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

ProbeError

Startup probe error: Get "http://10.132.0.206:15021/healthz/ready": dial tcp 10.132.0.206:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-550b8a-openshift-default-8c677bf7-mhq7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-804014-f8fb8f799-7slhs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-804014-6d666759c5-4sgpm

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8319b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-b8319b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1cdd1d-59f8d69dfc-5wmrj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1cdd1d-ff69dc895-x6mlt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5df48fcc99 from 3 to 2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-j94nh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-1cdd1d-openshift-default-784c85765c-tphpc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-804014-openshift-default-76dc5db6b9-prkw5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-b8319b-7c8cd46599-ssm8x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-b8319b-76d48b85cf-gst8v

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-c2c259-564f6fc64c-vgfzv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-ad9e22-7bd5748db7-ltg8p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-ad9e22-f8c6dbd69-ts587

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-praxis-b-b8319b-openshift-default-567b77d49-6zv5k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a9c5b3-58fbb5d6bc-8hdkq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a9c5b3-5bd4ff54f-dsmwg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

Unhealthy

Readiness probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-ad9e22-openshift-default-6dfdc6589-bsphz

ProbeError

Readiness probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f7545f-88c6646c5-kf6pz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f7545f-69cb5747cf-tr5hs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-f7545f-openshift-default-6846cb4869-p76tl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5df48fcc99-hdk28

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5df48fcc99

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-5df48fcc99-hdk28

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-5df48fcc99 from 2 to 1
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4adf4c-6fdb48945c-cpmhp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-4adf4c-openshift-default-647bb7f855-gtf5x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-fb1c1f-openshift-default-6cb7dc57c9-dqfkj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-865066-b699f8cbf-q9ghb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-865066-openshift-default-6559876c99-rzp2b

Killing

Stopping container istio-proxy