Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4 to ip-10-0-133-163.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5b55749cb7-zt7rl to ip-10-0-131-112.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5b55749cb7-qmk67 to ip-10-0-133-163.us-west-1.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5b55749cb7-lm22b to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-59cf4dc6bfb8rqj

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-59cf4dc6bfb8rqj to ip-10-0-133-163.us-west-1.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-fj5pj to ip-10-0-133-163.us-west-1.compute.internal

opendatahub

test-curl-11262-299ddb

Scheduled

Successfully assigned opendatahub/test-curl-11262-299ddb to ip-10-0-133-163.us-west-1.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-sdz2h

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-sdz2h to ip-10-0-131-112.us-west-1.compute.internal

opendatahub

test-curl-11259-e7fc1a

Scheduled

Successfully assigned opendatahub/test-curl-11259-e7fc1a to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

test-curl-11259-62a0bb

Scheduled

Successfully assigned opendatahub/test-curl-11259-62a0bb to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

test-curl-11259-30a5ee

Scheduled

Successfully assigned opendatahub/test-curl-11259-30a5ee to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

test-curl-11259-18b6ec

Scheduled

Successfully assigned opendatahub/test-curl-11259-18b6ec to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

test-curl-11259-01a2e3

Scheduled

Successfully assigned opendatahub/test-curl-11259-01a2e3 to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

test-curl-11256-c2b7ec

Scheduled

Successfully assigned opendatahub/test-curl-11256-c2b7ec to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l to ip-10-0-137-74.us-west-1.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-wqbbg

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-wqbbg to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-nm8gk to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl to ip-10-0-133-163.us-west-1.compute.internal

opendatahub

test-curl-11256-3318f5

Scheduled

Successfully assigned opendatahub/test-curl-11256-3318f5 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-nmpc6 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd to ip-10-0-131-112.us-west-1.compute.internal

opendatahub

test-curl-11256-20c1c8

Scheduled

Successfully assigned opendatahub/test-curl-11256-20c1c8 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr to ip-10-0-131-112.us-west-1.compute.internal

kuadrant-system

authorino-56c6c9ddd5-nxjmt

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-nxjmt to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk to ip-10-0-131-112.us-west-1.compute.internal

kuadrant-system

authorino-57f7f8659f-rckpv

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-rckpv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf to ip-10-0-137-74.us-west-1.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh to ip-10-0-133-163.us-west-1.compute.internal

kuadrant-system

authorino-5ccd9d7cb9-hg9ft

Scheduled

Successfully assigned kuadrant-system/authorino-5ccd9d7cb9-hg9ft to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz to ip-10-0-137-74.us-west-1.compute.internal

kuadrant-system

authorino-6db4498c4d-9ml7r

Scheduled

Successfully assigned kuadrant-system/authorino-6db4498c4d-9ml7r to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k to ip-10-0-131-112.us-west-1.compute.internal

kuadrant-system

authorino-6f6944bcdd-79j5r

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-79j5r to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-6gsrf to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8 to ip-10-0-131-112.us-west-1.compute.internal

kuadrant-system

authorino-78c9c77858-nq6sx

Scheduled

Successfully assigned kuadrant-system/authorino-78c9c77858-nq6sx to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-84v2t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-84v2t to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-xmc9j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-xmc9j to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-gzc2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-gzc2f to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-cn88q to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-kj8qb to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv to ip-10-0-133-163.us-west-1.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-tlh72

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-tlh72 to ip-10-0-133-163.us-west-1.compute.internal

opendatahub

odh-model-controller-769875db56-qj42d

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-qj42d to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d1107301-openshift-default-7c647db76c-2szsh to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7 to ip-10-0-133-163.us-west-1.compute.internal

opendatahub

model-serving-api-75bd89fdfc-rhpmb

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-rhpmb to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4 to ip-10-0-131-112.us-west-1.compute.internal

cert-manager

cert-manager-597b95cb84-htj4h

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-htj4h to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-lm5rm to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-ph22f to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns to ip-10-0-137-74.us-west-1.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-xgxnp

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-xgxnp to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-mtpnz to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-mfxjl to ip-10-0-133-163.us-west-1.compute.internal

opendatahub

maas-controller-7dbf54fd5c-ttkx8

Scheduled

Successfully assigned opendatahub/maas-controller-7dbf54fd5c-ttkx8 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-6a5285-openshift-default-6596676675-lfxqb to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j to ip-10-0-133-163.us-west-1.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-84qbj

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-84qbj to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-lpxkv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-pvrnj to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

maas-controller-57f6c8c568-lb862

Scheduled

Successfully assigned opendatahub/maas-controller-57f6c8c568-lb862 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-gnf96 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-dmsh8 to ip-10-0-137-74.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-fxd5p

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-fxd5p to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-wld4d to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx to ip-10-0-131-112.us-west-1.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-lmphn

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lmphn to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-cjfrk to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4 to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-r9zv9

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-r9zv9 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch to ip-10-0-137-74.us-west-1.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-p57jd

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-p57jd to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-cdwxx to ip-10-0-133-163.us-west-1.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-p4qfk

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-p4qfk to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-c7sb7 to ip-10-0-137-74.us-west-1.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-6spg5

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-6spg5 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-6qhq2 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-6j5w8 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk to ip-10-0-133-163.us-west-1.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dsph6

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-dsph6 to ip-10-0-131-112.us-west-1.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-2f5bd

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-2f5bd to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-5lq87

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-5lq87 to ip-10-0-131-112.us-west-1.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-kh22l

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-kh22l to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz to ip-10-0-131-112.us-west-1.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

Scheduled

Successfully assigned openshift-ingress/e2e-noten-00359a-openshift-default-6764dcd565-4l58q to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9 to ip-10-0-137-74.us-west-1.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-bm2wq

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-bm2wq to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2 to ip-10-0-131-112.us-west-1.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-vnxgf to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

router-default-648db889-4lftz

FailedScheduling

no nodes available to schedule pods

openshift-ingress

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

router-default-648db889-4lftz

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-648db889-4lftz

Scheduled

Successfully assigned openshift-ingress/router-default-648db889-4lftz to ip-10-0-137-74.us-west-1.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-qlqqk

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-qlqqk to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-5552h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-5552h to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89 to ip-10-0-131-112.us-west-1.compute.internal

opendatahub

ai-gateway-controller-7fcb66b96b-dwcmz

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7fcb66b96b-dwcmz to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-277pb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-277pb to ip-10-0-133-163.us-west-1.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-7tpjk

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-7tpjk to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt to ip-10-0-131-112.us-west-1.compute.internal

openshift-jobset-operator

jobset-controller-manager-58db569bd8-bmb6f

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-58db569bd8-bmb6f to ip-10-0-133-163.us-west-1.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2 to ip-10-0-131-112.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-cbb4b6c58-x6vr6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-cbb4b6c58-x6vr6 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-q9rnh to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-66599bc4bb-z7fp2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66599bc4bb-z7fp2 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-58847f9fc5-xfdrd to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb to ip-10-0-131-112.us-west-1.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-hxn75

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-hxn75 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

Scheduled

Successfully assigned openshift-ingress/e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt to ip-10-0-131-112.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-cbb4b6c58-87h44

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-cbb4b6c58-87h44 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

kube-auth-proxy-66599bc4bb-sx4rr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66599bc4bb-sx4rr to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg to ip-10-0-133-163.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-777d6b586f-brq7x

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-777d6b586f-brq7x to ip-10-0-133-163.us-west-1.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-9587p

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-9587p to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-398828-openshift-default-5647988965-bjxc6 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

Scheduled

Successfully assigned openshift-ingress/e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw to ip-10-0-133-163.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-76bc6b7c84-sn57j

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-76bc6b7c84-sn57j to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-2kx7j

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-2kx7j to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9 to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf to ip-10-0-133-163.us-west-1.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf to ip-10-0-131-112.us-west-1.compute.internal

models-as-a-service

payload-processing-external-model-6c456c64b9-drg8b

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6c456c64b9-drg8b to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5 to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz to ip-10-0-131-112.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-csm6n

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-csm6n to ip-10-0-133-163.us-west-1.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-lqm9w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lqm9w to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2 to ip-10-0-137-74.us-west-1.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-648db889 from 0 to 1

openshift-ingress

replicaset-controller

router-default-648db889

SuccessfulCreate

Created pod: router-default-648db889-4lftz

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-648db889-4lftz

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-648db889-4lftz

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-648db889-4lftz

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-648db889-4lftz

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-648db889-4lftz

Created

Container created

openshift-ingress

kubelet

router-default-648db889-4lftz

Started

Container started

openshift-ingress

kubelet

router-default-648db889-4lftz

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-648db889-4lftz

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-2kx7j

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kx7j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-2kx7j

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kx7j

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kx7j

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kx7j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.182s (4.182s including waiting). Image size: 185476477 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kx7j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-856b6dffcf

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-856b6dffcf from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kx7j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-cdwxx

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.648s (9.648s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856b6dffcf-8jm8s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.684s (9.684s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5b55749cb7

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5b55749cb7-qmk67

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-5b55749cb7 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5b55749cb7

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5b55749cb7-lm22b

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-5b55749cb7

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-5b55749cb7-zt7rl

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5b55749cb7-lm22b

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5b55749cb7-qmk67

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

operator-lifecycle-manager

install-n6jpl

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.004s (4.005s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.491s (3.491s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.728s (3.728s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 824ms (824ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-qmk67

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 840ms (840ms including waiting). Image size: 273709574 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-zt7rl

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-5b55749cb7-zt7rl_08d604b3-14e6-4148-b376-feeea1a010f2

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-5b55749cb7-zt7rl_08d604b3-14e6-4148-b376-feeea1a010f2 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-5b55749cb7-lm22b

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 1.012s (1.012s including waiting). Image size: 273709574 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-xgxnp

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-xgxnp

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-9587p

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-9587p

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xgxnp

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9587p

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-tlh72

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xgxnp

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xgxnp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.761s (3.761s including waiting). Image size: 190804149 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-xgxnp

Created

Container created

kuadrant-system

dns-operator-controller-manager-8557cbdb84-xgxnp_e2d43957-220f-4e69-9673-6413502154fd

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-xgxnp_e2d43957-220f-4e69-9673-6413502154fd became leader

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9587p

Started

Container started

kuadrant-system

multus

authorino-operator-7b7bb4bc77-tlh72

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9587p

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-tlh72

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-9587p

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 4.552s (4.552s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-9587p_54ecdcf0-9a43-4b8d-ba45-98a9ba12f302 became leader

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-tlh72

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-tlh72

Started

Container started

kuadrant-system

authorino-operator-7b7bb4bc77-tlh72_226bf7ce-e618-4355-914a-b25849bb46eb

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-tlh72_226bf7ce-e618-4355-914a-b25849bb46eb became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-tlh72

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.712s (2.712s including waiting). Image size: 167738465 bytes.

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-dsph6

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dsph6

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-dsph6

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-wqbbg

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dsph6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 4.428s (4.428s including waiting). Image size: 177967631 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wqbbg

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

limitador-operator-controller-manager-5778bb4449-dsph6_70cd887d-9fd5-4719-8057-26d50b1aed9c

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-dsph6_70cd887d-9fd5-4719-8057-26d50b1aed9c became leader

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-wqbbg

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dsph6

Created

Container created

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-dsph6

Started

Container started

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-sdz2h

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdz2h

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-sdz2h

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-lmphn

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-lmphn

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-lmphn

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-z7fp2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing
(x10)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

openshift-ingress

multus

kube-auth-proxy-66599bc4bb-sx4rr

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-59cf4dc6bf from 0 to 1

openshift-ingress

replicaset-controller

kube-auth-proxy-66599bc4bb

SuccessfulCreate

Created pod: kube-auth-proxy-66599bc4bb-z7fp2

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-66599bc4bb from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-66599bc4bb

SuccessfulCreate

Created pod: kube-auth-proxy-66599bc4bb-sx4rr
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-59cf4dc6bf

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-59cf4dc6bfb8rqj

openshift-ingress

multus

kube-auth-proxy-66599bc4bb-z7fp2

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-lmphn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.729s (5.729s including waiting). Image size: 424244516 bytes.

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-59cf4dc6bfb8rqj

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfb8rqj

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-sx4rr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wqbbg

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 8.592s (8.592s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wqbbg

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-wqbbg

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdz2h

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfb8rqj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdz2h

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-59cf4dc6bfb8rqj

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-lmphn

Created

Container created

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-lmphn_4cd14912-22a9-4456-a564-9934c78e0414

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-lmphn_4cd14912-22a9-4456-a564-9934c78e0414 became leader

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-sdz2h

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 6.482s (6.482s including waiting). Image size: 309650901 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-lmphn

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-sx4rr

Started

Container started

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-htj4h

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-sx4rr

Created

Container created

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-sx4rr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.934s (2.934s including waiting). Image size: 188904677 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-htj4h

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-z7fp2

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-z7fp2

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-66599bc4bb-z7fp2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.645s (3.645s including waiting). Image size: 188904677 bytes.

cert-manager

multus

cert-manager-597b95cb84-htj4h

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-htj4h

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-htj4h

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-htj4h

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.328s (3.328s including waiting). Image size: 309650901 bytes.

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-2f5bd

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-2f5bd

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-2f5bd

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-2f5bd

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-2f5bd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 1.988s (1.988s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-2f5bd

Created

Container created

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-fjmvm"
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-whjxm"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

opendatahub

kserve-module-controller-manager-7566cf5fc8-2f5bd_57c16302-5cdb-4255-a294-01717bacdfe9

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-2f5bd_57c16302-5cdb-4255-a294-01717bacdfe9 became leader

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-58db569bd8

SuccessfulCreate

Created pod: jobset-controller-manager-58db569bd8-bmb6f

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-58db569bd8 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

kubelet

jobset-controller-manager-58db569bd8-bmb6f

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

multus

jobset-controller-manager-58db569bd8-bmb6f

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-58db569bd8-bmb6f

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.084s (4.084s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-58db569bd8-bmb6f

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-58db569bd8-bmb6f

Started

Container started

openshift-jobset-operator

jobset-controller-manager-58db569bd8-bmb6f_68edeb7e-f09c-4964-bec5-6b39ba0699bb

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-58db569bd8-bmb6f_68edeb7e-f09c-4964-bec5-6b39ba0699bb became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-lqm9w

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lqm9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lqm9w

Created

Container created

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-lqm9w

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lqm9w

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lqm9w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-lqm9w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-2kx7j

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-2kx7j

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-kh22l

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

multus

odh-model-controller-769875db56-qj42d

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-qj42d

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-r9zv9

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-rhpmb

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-r9zv9

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-r9zv9

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kh22l

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

kubelet

model-serving-api-75bd89fdfc-rhpmb

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

odh-model-controller-769875db56-qj42d

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

model-serving-api-75bd89fdfc-rhpmb

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-kh22l

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-r9zv9

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-r9zv9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.073s (2.073s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-r9zv9

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kh22l

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kh22l

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.226s (3.226s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-kh22l

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-rhpmb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.936s (2.936s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-rhpmb

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-rhpmb

Started

Container started

opendatahub

llmisvc-controller-manager-869d5dcc5d-r9zv9_01cbf306-3175-4d06-8fd2-d1491791f320

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-r9zv9_01cbf306-3175-4d06-8fd2-d1491791f320 became leader

opendatahub

kubelet

odh-model-controller-769875db56-qj42d

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-qj42d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.679s (3.679s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-qj42d

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-kh22l_b1891a25-f156-4afb-883f-1adeca414930

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-kh22l_b1891a25-f156-4afb-883f-1adeca414930 became leader

opendatahub

odh-model-controller-769875db56-qj42d_e3cf3cac-23b5-4b31-a144-af7be6efc712

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-qj42d_e3cf3cac-23b5-4b31-a144-af7be6efc712 became leader
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-lmphn

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-fxd5p

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

NeedsReinstall

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-fxd5p

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

ComponentUnhealthy

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fxd5p

Pulled

Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine and can be accessed by the pod

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fxd5p

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-fxd5p

Started

Container started
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-fxd5p_647df911-86e3-47d6-9d32-f0811f43c1a3

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-fxd5p_647df911-86e3-47d6-9d32-f0811f43c1a3 became leader

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-p57jd

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-84qbj

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-p57jd

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-84qbj

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-84qbj

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

limitador-limitador-74dfcfb894-p57jd

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-rckpv

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-p4qfk

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p4qfk

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-7c9b87d574-p4qfk

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-rckpv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-rckpv

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-p57jd

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-p57jd

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-p57jd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 3.84s (3.84s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p4qfk

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p4qfk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.72s (1.72s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-p4qfk

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-nxjmt

kuadrant-system

multus

authorino-56c6c9ddd5-nxjmt

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-rckpv

Started

Container started

kuadrant-system

kubelet

authorino-57f7f8659f-rckpv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.789s (2.789s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-rckpv

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-nxjmt

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-84qbj

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-84qbj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.512s (6.512s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-84qbj

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-nxjmt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.389s (1.389s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-nxjmt

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-nxjmt

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-rckpv

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-rckpv

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-p57jd

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-p57jd

Killing

Stopping container limitador

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-57f6c8c568 from 0 to 1

opendatahub

replicaset-controller

maas-controller-57f6c8c568

SuccessfulCreate

Created pod: maas-controller-57f6c8c568-lb862

opendatahub

kubelet

maas-controller-57f6c8c568-lb862

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "maas-controller-metrics-tls" not found

opendatahub

replicaset-controller

maas-controller-7dbf54fd5c

SuccessfulCreate

Created pod: maas-controller-7dbf54fd5c-ttkx8

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7dbf54fd5c from 0 to 1

opendatahub

multus

maas-controller-7dbf54fd5c-ttkx8

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-57f6c8c568-lb862

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:5195902658b82f324d24095d3e7f7a8766349d36a46386fc89e8702e7ed2c60f"

opendatahub

multus

maas-controller-57f6c8c568-lb862

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7dbf54fd5c-ttkx8

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:5195902658b82f324d24095d3e7f7a8766349d36a46386fc89e8702e7ed2c60f"

opendatahub

kubelet

maas-controller-7dbf54fd5c-ttkx8

Created

Container created

opendatahub

kubelet

maas-controller-57f6c8c568-lb862

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:5195902658b82f324d24095d3e7f7a8766349d36a46386fc89e8702e7ed2c60f" in 6.883s (6.883s including waiting). Image size: 200069635 bytes.

opendatahub

kubelet

maas-controller-57f6c8c568-lb862

Started

Container started

opendatahub

kubelet

maas-controller-7dbf54fd5c-ttkx8

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:5195902658b82f324d24095d3e7f7a8766349d36a46386fc89e8702e7ed2c60f" in 7.066s (7.066s including waiting). Image size: 200069635 bytes.

opendatahub

kubelet

maas-controller-57f6c8c568-lb862

Created

Container created

opendatahub

kubelet

maas-controller-7dbf54fd5c-ttkx8

Started

Container started

opendatahub

maas-controller-7dbf54fd5c-ttkx8_39b962e6-3c1c-4589-a89a-939a03f5442a

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7dbf54fd5c-ttkx8_39b962e6-3c1c-4589-a89a-939a03f5442a became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-57f6c8c568 from 1 to 0

opendatahub

replicaset-controller

maas-controller-57f6c8c568

SuccessfulDelete

Deleted pod: maas-controller-57f6c8c568-lb862

opendatahub

kubelet

maas-controller-57f6c8c568-lb862

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 14.133s (14.133s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-fj5pj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

ProbeError

Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Unhealthy

Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-79j5r

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6db4498c4d from 0 to 1

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-79j5r

kuadrant-system

replicaset-controller

authorino-6db4498c4d

SuccessfulCreate

Created pod: authorino-6db4498c4d-9ml7r

kuadrant-system

multus

authorino-6f6944bcdd-79j5r

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f6944bcdd-79j5r

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6db4498c4d-9ml7r

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6db4498c4d-9ml7r

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-6f6944bcdd-79j5r

Created

Container created

kuadrant-system

replicaset-controller

authorino-78c9c77858

SuccessfulCreate

Created pod: authorino-78c9c77858-nq6sx

kuadrant-system

kubelet

authorino-6f6944bcdd-79j5r

Started

Container started

kuadrant-system

replicaset-controller

authorino-6db4498c4d

SuccessfulDelete

Deleted pod: authorino-6db4498c4d-9ml7r

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6db4498c4d from 1 to 0

kuadrant-system

kubelet

authorino-6db4498c4d-9ml7r

Started

Container started

kuadrant-system

kubelet

authorino-6db4498c4d-9ml7r

Created

Container created

kuadrant-system

kubelet

authorino-6db4498c4d-9ml7r

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.283s (1.283s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-79j5r

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.564s (1.564s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-78c9c77858 from 0 to 1

kuadrant-system

kubelet

authorino-6f6944bcdd-79j5r

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-78c9c77858-nq6sx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-78c9c77858-nq6sx

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6db4498c4d-9ml7r

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-78c9c77858-nq6sx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.349s (1.349s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-78c9c77858-nq6sx

Created

Container created

kuadrant-system

kubelet

authorino-78c9c77858-nq6sx

Started

Container started

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-nxjmt

kuadrant-system

kubelet

authorino-56c6c9ddd5-nxjmt

Killing

Stopping container authorino

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-6spg5
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

opendatahub

multus

llmisvc-controller-manager-6466c554d8-6spg5

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-6spg5

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-6spg5

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-6spg5

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-6spg5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 772ms (772ms including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-r9zv9

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-r9zv9

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-7tpjk

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7tpjk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-7tpjk

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7tpjk

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7tpjk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 2.974s (2.974s including waiting). Image size: 183979434 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7tpjk

Created

Container created

opendatahub

ai-gateway-controller-7d85675f98-7tpjk_f3ea4653-384d-468e-aee9-89db40ac9bb8

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-7tpjk_f3ea4653-384d-468e-aee9-89db40ac9bb8 became leader

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-xmc9j
(x7)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-gzc2f

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-gzc2f

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-gzc2f

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-xmc9j

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xmc9j

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xmc9j

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-gzc2f

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-gzc2f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xmc9j

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-gzc2f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.016s (3.016s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xmc9j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.823s (2.823s including waiting). Image size: 125353963 bytes.

opendatahub

replicaset-controller

ai-gateway-controller-7fcb66b96b

SuccessfulCreate

Created pod: ai-gateway-controller-7fcb66b96b-dwcmz

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7fcb66b96b from 0 to 1

opendatahub

kubelet

ai-gateway-controller-7fcb66b96b-dwcmz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7fcb66b96b-dwcmz

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-7fcb66b96b-dwcmz

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7fcb66b96b-dwcmz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 878ms (878ms including waiting). Image size: 183979434 bytes.

opendatahub

kubelet

ai-gateway-controller-7fcb66b96b-dwcmz

Created

Container created

opendatahub

llmisvc-controller-manager-6466c554d8-6spg5_adeb6ea6-1ddf-47c9-b25a-70a9134089f3

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-6spg5_adeb6ea6-1ddf-47c9-b25a-70a9134089f3 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-7tpjk

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-7tpjk

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.212s (2.212s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kmlfj

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-bm2wq

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-bm2wq

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bm2wq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bm2wq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.447s (1.447s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bm2wq

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-bm2wq

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

opendatahub

ai-gateway-controller-7fcb66b96b-dwcmz_5e14d19e-7512-4c8c-ade0-1d81ecd526fd

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7fcb66b96b-dwcmz_5e14d19e-7512-4c8c-ade0-1d81ecd526fd became leader

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 586ms (587ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

Created

Container created

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-qlqqk

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-qlqqk

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qlqqk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qlqqk

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qlqqk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 586ms (586ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qlqqk

Started

Container started

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 574ms (575ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88xqfv

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-hxn75

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

kubelet

echo-simulator-kserve-64b6f8f96c-hxn75

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

multus

echo-simulator-kserve-64b6f8f96c-hxn75

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-hxn75

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.368s (2.368s including waiting). Image size: 78208878 bytes.

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-hxn75

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

kubelet

echo-simulator-kserve-64b6f8f96c-hxn75

Created

Container created

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 584ms (584ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-lpq5s

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 586ms (586ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-gnf96

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-gnf96

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.057s (4.057s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 2 to 4

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-xfdrd

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-mfxjl

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.892s (3.892s including waiting). Image size: 183555333 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

kuadrant-system

replicaset-controller

authorino-5ccd9d7cb9

SuccessfulCreate

Created pod: authorino-5ccd9d7cb9-hg9ft

kuadrant-system

kubelet

authorino-5ccd9d7cb9-hg9ft

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-5ccd9d7cb9-hg9ft

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused

kuadrant-system

replicaset-controller

authorino-78c9c77858

SuccessfulDelete

Deleted pod: authorino-78c9c77858-nq6sx
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-78c9c77858 from 1 to 0

kuadrant-system

kubelet

authorino-5ccd9d7cb9-hg9ft

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.31s (3.31s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5ccd9d7cb9-hg9ft

Created

Container created

kuadrant-system

kubelet

authorino-5ccd9d7cb9-hg9ft

Started

Container started

kuadrant-system

kubelet

authorino-78c9c77858-nq6sx

Killing

Stopping container authorino

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-6j5w8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ait-66a47a3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-66a47a3b-openshift-default-5fdf96d89c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-d1107301

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d1107301

openshift-ingress

deployment-controller

e2e-ait-d1107301-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d1107301-openshift-default-7c647db76c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-d1107301-openshift-default-7c647db76c

SuccessfulCreate

Created pod: e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

openshift-ingress

gateway_labeler_controller

e2e-migrate-935e4abf-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-935e4abf-gw

openshift-ingress

gateway_labeler_controller

e2e-ait-66a47a3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-66a47a3b

openshift-ingress

replicaset-controller

e2e-ait-66a47a3b-openshift-default-5fdf96d89c

SuccessfulCreate

Created pod: e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

openshift-ingress

multus

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5

SuccessfulCreate

Created pod: e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

openshift-ingress

multus

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-935e4abf-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-935e4abf-gw-openshift-default-759dd556b5 from 0 to 1

openshift-ingress

multus

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-4bbf98be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4bbf98be

openshift-ingress

deployment-controller

e2e-ait-4bbf98be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4bbf98be-openshift-default-5446cd585c from 0 to 1

openshift-ingress

multus

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-4bbf98be-openshift-default-5446cd585c

SuccessfulCreate

Created pod: e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

openshift-ingress

deployment-controller

e2e-derive-bc460382-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-bc460382-openshift-default-565fc557b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-bc460382-openshift-default-565fc557b5

SuccessfulCreate

Created pod: e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

openshift-ingress

gateway_labeler_controller

e2e-derive-bc460382

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-bc460382

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-935e4abf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-935e4abf-57498b49f5 from 0 to 1

openshift-ingress

multus

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-935e4abf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-935e4abf-7d747dd7d7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-935e4abf: serviceaccount "payload-processing-e2e-migrate-935e4abf" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-935e4abf-7d747dd7d7

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-935e4abf-7d747dd7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-935e4abf: serviceaccount "payload-processing-e2e-migrate-935e4abf" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-935e4abf-7d747dd7d7

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f

openshift-ingress

multus

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc

Started

Container started
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-66a47a3b-686d7444c9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-66a47a3b-686d7444c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-66a47a3b: serviceaccount "payload-processing-e2e-ait-66a47a3b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-66a47a3b: serviceaccount "payload-processing-e2e-ait-66a47a3b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-66a47a3b-686d7444c9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-66a47a3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-66a47a3b-686d7444c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-66a47a3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-66a47a3b-699d7d7899 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d1107301

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d1107301-7b968d8f77 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d1107301-7b968d8f77

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d1107301-7b968d8f77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d1107301: serviceaccount "payload-processing-e2e-ait-d1107301" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d1107301-675fb7899

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d1107301-675fb7899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d1107301: serviceaccount "payload-processing-e2e-ait-d1107301" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d1107301

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d1107301-675fb7899 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d1107301-675fb7899

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d1107301-7b968d8f77

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4bbf98be-b9594874c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4bbf98be-b9594874c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4bbf98be: serviceaccount "payload-processing-e2e-ait-4bbf98be" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4bbf98be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4bbf98be-57fd77bc87 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4bbf98be-57fd77bc87

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4bbf98be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4bbf98be-b9594874c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4bbf98be-57fd77bc87

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4bbf98be-57fd77bc87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4bbf98be: serviceaccount "payload-processing-e2e-ait-4bbf98be" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4bbf98be-b9594874c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-bc460382-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-bc460382-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-bc460382-7759547547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-bc460382-7759547547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-bc460382: serviceaccount "payload-processing-e2e-derive-bc460382" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-bc460382

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-bc460382-7c7dd66f5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-bc460382-7c7dd66f5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-bc460382-7c7dd66f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-bc460382: serviceaccount "payload-processing-e2e-derive-bc460382" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-bc460382

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-bc460382-7759547547 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-bc460382-7759547547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q

openshift-ingress

multus

payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-bc460382-7c7dd66f5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

Created

Container created

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

ProbeError

Readiness probe error: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

Unhealthy

Readiness probe failed: Get "http://10.133.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

Created

Container created

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

ProbeError

Readiness probe error: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

Unhealthy

Readiness probe failed: Get "http://10.133.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d1107301-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-66a47a3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-66a47a3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-d1107301-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-935e4abf-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-935e4abf-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-d1107301-7b968d8f77-c2tv7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d1107301-675fb7899-nsrpt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-bc460382-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-bc460382-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-migrate-935e4abf-7d747dd7d7-gs66f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-935e4abf-57498b49f5-qkrxc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d1107301-openshift-default-7c647db76c-2szsh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-ca6546

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-ca6546

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 0 to 1

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-66a47a3b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-migrate-935e4abf-gw-openshift-default-759dd556b5-gz55b

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-66a47a3b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-858236

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-858236

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-66a47a3b-686d7444c9-xk4nt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-66a47a3b-699d7d7899-pj48x

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-ca6546-8d886cbbf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-ca6546-8d886cbbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-ca6546: serviceaccount "payload-processing-e2e-worker-w2-ca6546" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-ca6546

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-ca6546-8d886cbbf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-ca6546: serviceaccount "payload-processing-e2e-worker-w2-ca6546" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-ca6546

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-ca6546-8d886cbbf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp

openshift-ingress

kubelet

e2e-ait-66a47a3b-openshift-default-5fdf96d89c-vzn7k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-ph22f

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-398828

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-398828

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-398828-openshift-default-5647988965 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc460382-7759547547-vgh7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-bc460382-7c7dd66f5-68kpj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4bbf98be-b9594874c-9fqx9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4bbf98be-57fd77bc87-5lzs4

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-858236-5c5788679f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-858236

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-858236-5c5788679f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-858236

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-858236-646789f8d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-858236-646789f8d5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-858236-646789f8d5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-858236-646789f8d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-858236: serviceaccount "payload-processing-e2e-worker-w3-858236" not found
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bbf98be-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-858236-5c5788679f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-858236-5c5788679f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-858236: serviceaccount "payload-processing-e2e-worker-w3-858236" not found
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-4bbf98be-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-398828

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-398828-75678b79b7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-398828

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-398828-54955d6b75 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-398828-54955d6b75

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-398828-54955d6b75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-398828: serviceaccount "payload-processing-e2e-worker-w4-398828" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-398828-75678b79b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-398828-75678b79b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-398828: serviceaccount "payload-processing-e2e-worker-w4-398828" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-398828-54955d6b75

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-398828-75678b79b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

Created

Container created

openshift-ingress

kubelet

e2e-derive-bc460382-openshift-default-565fc557b5-lbtjt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-5ac93f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-5ac93f

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-4bbf98be-openshift-default-5446cd585c-g4hdr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-1f6e39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-1f6e39

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-5ac93f: serviceaccount "payload-processing-e2e-worker-w1-5ac93f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-5ac93f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-5ac93f: serviceaccount "payload-processing-e2e-worker-w1-5ac93f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-5ac93f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl
(x2)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1f6e39-69f9854f95

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-1f6e39-69f9854f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1f6e39: serviceaccount "payload-processing-e2e-worker-w0-1f6e39" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-1f6e39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-1f6e39-69f9854f95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-1f6e39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1f6e39: serviceaccount "payload-processing-e2e-worker-w0-1f6e39" not found
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1f6e39-69f9854f95

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-mfxjl

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mfxjl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 5 to 4

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

Created

Container created

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

ProbeError

Startup probe error: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

Unhealthy

Startup probe failed: Get "http://10.134.0.92:15021/healthz/ready": dial tcp 10.134.0.92:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6c456c64b9 from 0 to 1
(x7)

models-as-a-service

replicaset-controller

payload-processing-external-model-6c456c64b9

FailedCreate

Error creating: pods "payload-processing-external-model-6c456c64b9-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-6c456c64b9

SuccessfulCreate

Created pod: payload-processing-external-model-6c456c64b9-drg8b

models-as-a-service

multus

payload-processing-external-model-6c456c64b9-drg8b

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6c456c64b9-drg8b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6c456c64b9-drg8b

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6c456c64b9-drg8b

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-76bc6b7c84-sn57j

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-76bc6b7c84-sn57j

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-76bc6b7c84-sn57j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-76bc6b7c84 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-76bc6b7c84-sn57j

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-76bc6b7c84

SuccessfulCreate

Created pod: payload-processing-external-model-76bc6b7c84-sn57j
(x5)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-cjfrk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-lpxkv

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-nmpc6

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-5lq87

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-5lq87

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 1 to 2

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 8 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-277pb

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-58847f9fc5-5552h

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-277pb

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-5552h

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-cbb4b6c58

SuccessfulCreate

Created pod: payload-processing-external-model-cbb4b6c58-x6vr6
(x6)

models-as-a-service

kubelet

payload-processing-external-model-76bc6b7c84-sn57j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-76bc6b7c84-sn57j

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-76bc6b7c84 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-76bc6b7c84

SuccessfulDelete

Deleted pod: payload-processing-external-model-76bc6b7c84-sn57j

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-x6vr6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-x6vr6

Started

Container started

models-as-a-service

multus

payload-processing-external-model-cbb4b6c58-x6vr6

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-x6vr6

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-cbb4b6c58

SuccessfulDelete

Deleted pod: payload-processing-external-model-cbb4b6c58-x6vr6

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-x6vr6

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-777d6b586f from 0 to 1
(x2)

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-x6vr6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

replicaset-controller

payload-processing-external-model-777d6b586f

SuccessfulCreate

Created pod: payload-processing-external-model-777d6b586f-brq7x

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-cbb4b6c58 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-777d6b586f-brq7x

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-777d6b586f-brq7x

Started

Container started

models-as-a-service

multus

payload-processing-external-model-777d6b586f-brq7x

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-777d6b586f-brq7x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

models-as-a-service

kubelet

payload-processing-external-model-6c456c64b9-drg8b

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-7d506ce743a8" not found

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6c456c64b9 from 1 to 0

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-6c456c64b9

SuccessfulDelete

Deleted pod: payload-processing-external-model-6c456c64b9-drg8b

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6c456c64b9-drg8b

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

Created

Container created

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

Started

Container started

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

ProbeError

Startup probe error: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

Unhealthy

Startup probe failed: Get "http://10.134.0.110:15021/healthz/ready": dial tcp 10.134.0.110:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Created

Container created

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-cbb4b6c58 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-cbb4b6c58

SuccessfulCreate

Created pod: payload-processing-external-model-cbb4b6c58-87h44

models-as-a-service

multus

payload-processing-external-model-cbb4b6c58-87h44

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-87h44

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-87h44

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-87h44

Created

Container created
(x3)

models-as-a-service

kubelet

payload-processing-external-model-777d6b586f-brq7x

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-06e7ce0d87b6" not found, secret "agc-cred-08e8b2351e52" not found]

models-as-a-service

kubelet

payload-processing-external-model-777d6b586f-brq7x

Killing

Stopping container payload-processing
(x2)

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-87h44

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-cbb4b6c58-87h44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

ProbeError

Readiness probe error: Get "http://10.134.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

ProbeError

Readiness probe error: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Unhealthy

Readiness probe failed: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

Unhealthy

Readiness probe failed: Get "http://10.134.0.100:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nmpc6

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

models-as-a-service

kubelet

payload-processing-external-model-777d6b586f-brq7x

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : [secret "agc-cred-06e7ce0d87b6" not found, secret "agc-cred-08e8b2351e52" not found, secret "agc-cred-cb01f95f8193" not found]

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Unhealthy

Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

ProbeError

Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

Started

Container started

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

ProbeError

Startup probe error: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

Unhealthy

Startup probe failed: Get "http://10.134.0.120:15021/healthz/ready": dial tcp 10.134.0.120:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

Created

Container created

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

Created

Container created

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

Created

Container created

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

Started

Container started

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

Created

Container created

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

ProbeError

Readiness probe error: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Unhealthy

Readiness probe failed: Get "http://10.134.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 8 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c
(x9)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

Created

Container created

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 6 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

Unhealthy

Startup probe failed: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

ProbeError

Startup probe error: Get "http://10.134.0.136:15021/healthz/ready": dial tcp 10.134.0.136:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-d5dcca72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d5dcca72

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

openshift-ingress

deployment-controller

e2e-mt-d5dcca72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d5dcca72-openshift-default-7c7c99b4c7 from 0 to 1

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d5dcca72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d5dcca72-7746cbb699 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d5dcca72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d5dcca72-846bb99569 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d5dcca72-846bb99569

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d5dcca72-846bb99569

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d5dcca72-846bb99569-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d5dcca72: serviceaccount "payload-processing-e2e-mt-d5dcca72" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d5dcca72: serviceaccount "payload-processing-e2e-mt-d5dcca72" not found

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

Unhealthy

Readiness probe failed: Get "https://10.134.0.57:8000/ready": context deadline exceeded
(x5)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-xlbmw

Unhealthy

Readiness probe failed: Get "https://10.134.0.57:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-vnxgf

Unhealthy

Readiness probe failed: Get "https://10.134.0.55:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-cn88q

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-csm6n

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-csm6n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-csm6n

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-398828-openshift-default-5647988965 from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-csm6n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 5.07s (5.07s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-csm6n

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-csm6n

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-398828-openshift-default-5647988965 from 5 to 7

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

Started

Container started

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

Created

Container created

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d5dcca72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d5dcca72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-ed15c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ed15c1-openshift-default-656fd8c59 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-ed15c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ed15c1

openshift-ingress

replicaset-controller

e2e-api-a-ed15c1-openshift-default-656fd8c59

SuccessfulCreate

Created pod: e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

openshift-ingress

replicaset-controller

e2e-api-a-0d26af-openshift-default-7d99cfb95

SuccessfulCreate

Created pod: e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

openshift-ingress

gateway_labeler_controller

e2e-api-a-0d26af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-0d26af

openshift-ingress

deployment-controller

e2e-api-a-0d26af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0d26af-openshift-default-7d99cfb95 from 0 to 1

openshift-ingress

multus

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x9)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d5dcca72-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d5dcca72-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ed15c1-56c5d6557c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ed15c1-56c5d6557c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ed15c1: serviceaccount "payload-processing-e2e-api-a-ed15c1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ed15c1-56c5d6557c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ed15c1: serviceaccount "payload-processing-e2e-api-a-ed15c1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ed15c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ed15c1-57bddc8787 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ed15c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ed15c1-56c5d6557c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2

Created

Container created
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0d26af-59668b6f65

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-0d26af-59668b6f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0d26af: serviceaccount "payload-processing-e2e-api-a-0d26af" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0d26af-59668b6f65

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0d26af-64f5446f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-0d26af-64f5446f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0d26af: serviceaccount "payload-processing-e2e-api-a-0d26af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0d26af-64f5446f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-0d26af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-0d26af-64f5446f47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-0d26af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-0d26af-59668b6f65 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 4 to 6

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7

Started

Container started

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

ProbeError

Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

Unhealthy

Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Unhealthy

Readiness probe failed: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

Unhealthy

Readiness probe failed: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

ProbeError

Readiness probe error: Get "http://10.134.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

ProbeError

Readiness probe error: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 6 to 8

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-a-b4a230-openshift-default-559b6d97b5

SuccessfulCreate

Created pod: e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

openshift-ingress

deployment-controller

e2e-api-a-b4a230-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b4a230-openshift-default-559b6d97b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-b4a230

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b4a230

openshift-ingress

multus

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b4a230

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b4a230-7f49b69f9f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b4a230-7f49b69f9f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b4a230-7f49b69f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b4a230: serviceaccount "payload-processing-e2e-api-a-b4a230" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b4a230-7f49b69f9f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b4a230

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b4a230: serviceaccount "payload-processing-e2e-api-a-b4a230" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ed15c1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-ed15c1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-d6544b-openshift-default-799cbf6845

SuccessfulCreate

Created pod: e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

openshift-ingress

deployment-controller

e2e-api-b-d6544b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d6544b-openshift-default-799cbf6845 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-d6544b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d6544b

openshift-ingress

multus

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

opendatahub

multus

test-curl-11256-3318f5

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11256-3318f5

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

replicaset-controller

e2e-api-a-c9d1fc-openshift-default-5f54f45b77

SuccessfulCreate

Created pod: e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

openshift-ingress

deployment-controller

e2e-api-a-c9d1fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c9d1fc-openshift-default-5f54f45b77 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-c9d1fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c9d1fc

openshift-ingress

multus

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-018cfa-openshift-default-86cbf9f749

SuccessfulCreate

Created pod: e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

openshift-ingress

deployment-controller

e2e-api-b-018cfa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-018cfa-openshift-default-86cbf9f749 from 0 to 1

opendatahub

kubelet

test-curl-11256-3318f5

Created

Container created

opendatahub

kubelet

test-curl-11256-3318f5

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-018cfa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-018cfa

opendatahub

kubelet

test-curl-11256-3318f5

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.092s (3.092s including waiting). Image size: 106100986 bytes.

openshift-ingress

multus

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11256-3318f5

Killing

Stopping container test-curl-11256-3318f5

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d6544b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d6544b-5fc969d5f9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d6544b-5fc969d5f9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d6544b-5fc969d5f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d6544b: serviceaccount "payload-processing-e2e-api-b-d6544b" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0d26af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d6544b-5fc969d5f9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d6544b-75f96f97f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0d26af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d6544b-75f96f97f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d6544b-75f96f97f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d6544b: serviceaccount "payload-processing-e2e-api-b-d6544b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d6544b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d6544b-75f96f97f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c9d1fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c9d1fc-ffdc6cb67 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c9d1fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c9d1fc: serviceaccount "payload-processing-e2e-api-a-c9d1fc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c9d1fc: serviceaccount "payload-processing-e2e-api-a-c9d1fc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-018cfa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-018cfa-7979545787 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-018cfa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-018cfa-74666c99c9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-018cfa-74666c99c9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-018cfa-74666c99c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-018cfa: serviceaccount "payload-processing-e2e-api-b-018cfa" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-018cfa-7979545787

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-018cfa-7979545787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-018cfa: serviceaccount "payload-processing-e2e-api-b-018cfa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-018cfa-7979545787

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-018cfa-74666c99c9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv

openshift-ingress

kubelet

payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0d26af-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-0d26af-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-h8cx9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-wldb8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

Started

Container started

openshift-ingress

multus

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-a27da5-openshift-default-68bb95fc4c

SuccessfulCreate

Created pod: e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

openshift-ingress

deployment-controller

e2e-api-b-a27da5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a27da5-openshift-default-68bb95fc4c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-a27da5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a27da5
(x6)

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b4a230-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b4a230-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a27da5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a27da5-74bf9f44b5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a27da5-74bf9f44b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a27da5: serviceaccount "payload-processing-e2e-api-b-a27da5" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a27da5: serviceaccount "payload-processing-e2e-api-b-a27da5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a27da5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a27da5-74bf9f44b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a27da5-74bf9f44b5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr

openshift-ingress

kubelet

payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh

openshift-ingress

multus

payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b4a230-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-b4a230-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c9d1fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c9d1fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d5dcca72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d5dcca72-846bb99569 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d5dcca72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d5dcca72-7746cbb699 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d5dcca72-846bb99569

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d5dcca72-846bb99569-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d5dcca72: serviceaccount "payload-processing-e2e-mt-d5dcca72" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d5dcca72: serviceaccount "payload-processing-e2e-mt-d5dcca72" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d5dcca72-846bb99569

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4

openshift-ingress

multus

payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4

AddedInterface

Add eth0 [10.134.0.168/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-w2ms9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-q4d4c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-zrgw5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tczn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-j6cr2

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-swgkh

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hrftn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c9d1fc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-c9d1fc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 8 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-cn88q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulDelete

Deleted pod: e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-398828-openshift-default-5647988965 from 7 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulDelete

Deleted pod: e2e-worker-w4-398828-openshift-default-5647988965-cn88q

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-6gsrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d6544b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-d6544b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xsk98

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-bnz6w

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

Unhealthy

Readiness probe failed: Get "http://10.134.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-b-c170e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-c170e9

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hdjcq

ProbeError

Readiness probe error: Get "http://10.134.0.124:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-api-b-c170e9-openshift-default-7544f57bdf

SuccessfulCreate

Created pod: e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

openshift-ingress

deployment-controller

e2e-api-b-c170e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-c170e9-openshift-default-7544f57bdf from 0 to 1

openshift-ingress

multus

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-018cfa-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-018cfa-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-a-ed15c1-56c5d6557c-g5df2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ed15c1-57bddc8787-l7kbv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulDelete

Deleted pod: e2e-worker-w4-398828-openshift-default-5647988965-lm5rm

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-398828-openshift-default-5647988965 from 5 to 4

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-c170e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-c170e9-67fcf76c9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c170e9-dfb74f975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-c170e9-dfb74f975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c170e9: serviceaccount "payload-processing-e2e-api-b-c170e9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-c170e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-c170e9-dfb74f975 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-c170e9-dfb74f975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c170e9-67fcf76c9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-c170e9-67fcf76c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-c170e9: serviceaccount "payload-processing-e2e-api-b-c170e9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-c170e9-67fcf76c9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt

openshift-ingress

multus

payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.706s (2.706s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-0d26af-59668b6f65-dz2f7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0d26af-64f5446f47-qnwqh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a27da5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a27da5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-b4a230-7f49b69f9f-jfcml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b4a230-5666cf5b6c-vv8cx

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a27da5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a27da5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d5dcca72-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

openshift-ingress

deployment-controller

e2e-mt-d5dcca72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d5dcca72-openshift-default-7c7c99b4c7 from 1 to 4

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

Started

Container started

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

Started

Container started

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

Created

Container created

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

Started

Container started

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

Created

Container created

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

Created

Container created

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d5dcca72-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

openshift-ingress

deployment-controller

e2e-mt-d5dcca72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d5dcca72-openshift-default-7c7c99b4c7 from 4 to 8

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

Started

Container started

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

Created

Container created

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

Started

Container started

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

Started

Container started

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

AddedInterface

Add eth0 [10.134.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

Started

Container started

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

Created

Container created

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

Created

Container created

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

Created

Container created

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

ProbeError

Startup probe error: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

Unhealthy

Startup probe failed: Get "http://10.134.0.175:15021/healthz/ready": dial tcp 10.134.0.175:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

opendatahub

multus

test-curl-11256-20c1c8

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11256-20c1c8

Started

Container started

opendatahub

kubelet

test-curl-11256-20c1c8

Created

Container created

opendatahub

kubelet

test-curl-11256-20c1c8

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-d5dcca72-openshift-default

SuccessfulRescale

New size: 9; reason:

openshift-ingress

replicaset-controller

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7

SuccessfulCreate

Created pod: e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl
(x2)

openshift-ingress

kubelet

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

Started

Container started

openshift-ingress

deployment-controller

e2e-mt-d5dcca72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d5dcca72-openshift-default-7c7c99b4c7 from 8 to 9

openshift-ingress

multus

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

Started

Container started

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

Created

Container created

opendatahub

kubelet

test-curl-11256-20c1c8

Killing

Stopping container test-curl-11256-20c1c8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c170e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c170e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-vlcns

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-rr4xs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 10 to 5

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

Unhealthy

Startup probe failed: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

ProbeError

Startup probe error: Get "http://10.134.0.177:15021/healthz/ready": dial tcp 10.134.0.177:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 8 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-ljzh9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-ltbbz

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-4djkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-lxgxm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-ed15c1-openshift-default-656fd8c59-6rn68

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-hxj9t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-lzgvw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-n25hz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-xfdrd

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-6j5w8

openshift-ingress

kubelet

e2e-api-a-0d26af-openshift-default-7d99cfb95-7vgc4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-cjfrk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 10 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6j5w8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-5552h

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-d5dcca72-846bb99569-sjdx4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5dcca72-7746cbb699-tmsrl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-xfdrd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cjfrk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5552h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-d6544b-5fc969d5f9-7k5sq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d6544b-75f96f97f-6m8n2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-018cfa-74666c99c9-pv5nv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-018cfa-7979545787-tsnwm

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c170e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-c170e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c9d1fc-5b9c6db48c-lkdss

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c9d1fc-ffdc6cb67-6nwgq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-b4a230-openshift-default-559b6d97b5-54djx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-a27da5-74bf9f44b5-xdcnr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a27da5-85ccf9bfcf-mhsrh

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-x5gwb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 6 to 5

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 5 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-277pb

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-398828-openshift-default-5647988965 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulDelete

Deleted pod: e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-xstsp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-277pb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-bjxc6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-fn4nf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-h2hj7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-ff2fd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q48lc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-wrf54

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-k649k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-tcdp8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-t4dvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d5dcca72-openshift-default-7c7c99b4c7-q97pb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-6a5285

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6a5285

openshift-ingress

multus

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-6a5285-openshift-default-6596676675

SuccessfulCreate

Created pod: e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

openshift-ingress

deployment-controller

e2e-api-a-6a5285-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-6a5285-openshift-default-6596676675 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-5fp6v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-d6544b-openshift-default-799cbf6845-xw2gz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6a5285-599746bcc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6a5285-599746bcc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-6a5285-599746bcc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6a5285: serviceaccount "payload-processing-e2e-api-a-6a5285" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-6a5285

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-6a5285-599746bcc5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-6a5285

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-6a5285-7df9d5c5b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6a5285-7df9d5c5b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6a5285-7df9d5c5b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-6a5285-7df9d5c5b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6a5285: serviceaccount "payload-processing-e2e-api-a-6a5285" not found

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-c9d1fc-openshift-default-5f54f45b77-t97ch

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-018cfa-openshift-default-86cbf9f749-jn2gn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-c170e9-67fcf76c9-f4kkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-c170e9-dfb74f975-wmv5m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xlfg9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-cszr2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-4c3ea5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-4c3ea5

openshift-ingress

replicaset-controller

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45

SuccessfulCreate

Created pod: e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

openshift-ingress

deployment-controller

e2e-shared-a-w2-4c3ea5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-a27da5-openshift-default-68bb95fc4c-rbh85

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-dd87f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-dd87f0

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-4c3ea5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-4c3ea5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4c3ea5: serviceaccount "payload-processing-e2e-shared-a-w2-4c3ea5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

openshift-ingress

deployment-controller

e2e-ipp-a-dd87f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-dd87f0-openshift-default-566d797d85 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-dd87f0-openshift-default-566d797d85

SuccessfulCreate

Created pod: e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

openshift-ingress

multus

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-4c3ea5: serviceaccount "payload-processing-e2e-shared-a-w2-4c3ea5" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-dmsh8
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 5 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-6qhq2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-nm8gk

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-c7sb7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-q9rnh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd87f0: serviceaccount "payload-processing-e2e-ipp-a-dd87f0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dd87f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dd87f0-5cb57977f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd87f0: serviceaccount "payload-processing-e2e-ipp-a-dd87f0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dd87f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

ProbeError

Startup probe error: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

Unhealthy

Startup probe failed: Get "http://10.134.0.185:15021/healthz/ready": dial tcp 10.134.0.185:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.347s (3.347s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 4.172s (4.172s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-045653

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-045653

openshift-ingress

deployment-controller

e2e-ipp-a-045653-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-045653-openshift-default-7dfd4bcd69 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-045653-openshift-default-7dfd4bcd69

SuccessfulCreate

Created pod: e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

openshift-ingress

multus

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-045653

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-045653-594b8444f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-045653

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-045653-8598bc489f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-045653-8598bc489f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-045653-8598bc489f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-045653-8598bc489f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-045653: serviceaccount "payload-processing-e2e-ipp-a-045653" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-045653-594b8444f9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-045653-594b8444f9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-045653-594b8444f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-045653: serviceaccount "payload-processing-e2e-ipp-a-045653" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a5285-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a5285-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a5285-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-6a5285-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-b-f1a692

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f1a692

openshift-ingress

multus

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-f1a692-openshift-default-5d6d98688f

SuccessfulCreate

Created pod: e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

openshift-ingress

deployment-controller

e2e-api-b-f1a692-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f1a692-openshift-default-5d6d98688f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulDelete

Deleted pod: e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-398828-openshift-default-5647988965 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-c170e9-openshift-default-7544f57bdf-wmxwp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-abc348-openshift-default-7bd4495477

SuccessfulCreate

Created pod: e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-abc348

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-abc348

openshift-ingress

deployment-controller

e2e-ipp-a-abc348-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-abc348-openshift-default-7bd4495477 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-045653-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-045653-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-kj8qb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f1a692

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f1a692-769dbb76cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f1a692

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f1a692-5779dfbc9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f1a692-769dbb76cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f1a692-769dbb76cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f1a692: serviceaccount "payload-processing-e2e-api-b-f1a692" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f1a692-769dbb76cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f1a692: serviceaccount "payload-processing-e2e-api-b-f1a692" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-abc348

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-abc348-765fc6594c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-abc348

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-abc348-765fc6594c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-abc348-765fc6594c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-abc348: serviceaccount "payload-processing-e2e-ipp-a-abc348" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-abc348-765fc6594c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-abc348: serviceaccount "payload-processing-e2e-ipp-a-abc348" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4c3ea5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4c3ea5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-xndmc

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd87f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd87f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w2-d94cc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-d94cc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-d94cc3

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45

SuccessfulCreate

Created pod: e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-s9dfr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4c3ea5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-4c3ea5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-d94cc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-d94cc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-d94cc3: serviceaccount "payload-processing-e2e-shared-b-w2-d94cc3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

ProbeError

Readiness probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

Unhealthy

Readiness probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-d94cc3: serviceaccount "payload-processing-e2e-shared-b-w2-d94cc3" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 5 to 3
(x2)

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-jx2rx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-qtwvf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-018375

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-018375
(x5)

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5d4c94f975-qcg74

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-018375-openshift-default-7fbc48965

SuccessfulCreate

Created pod: e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-5cb57977f9-hcrdg

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-b-018375-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-018375-openshift-default-7fbc48965 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-018375-778658cdb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-018375

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-018375-6b46774f5f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-018375

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-018375-778658cdb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-018375-6b46774f5f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-018375-6b46774f5f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-018375-6b46774f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-018375: serviceaccount "payload-processing-e2e-ipp-b-018375" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-018375-778658cdb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-018375-778658cdb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-018375: serviceaccount "payload-processing-e2e-ipp-b-018375" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd87f0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-dd87f0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-045653-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-045653-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-ipp-b-9d5625-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9d5625-openshift-default-667b78d6c9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9d5625

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9d5625

openshift-ingress

replicaset-controller

e2e-ipp-b-9d5625-openshift-default-667b78d6c9

SuccessfulCreate

Created pod: e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-8598bc489f-fhdw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-594b8444f9-crb5f

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9d5625

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9d5625-54769b969 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d5625-54769b969

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9d5625-54769b969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d5625: serviceaccount "payload-processing-e2e-ipp-b-9d5625" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d5625-54769b969

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9d5625

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d5625: serviceaccount "payload-processing-e2e-ipp-b-9d5625" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv

AddedInterface

Add eth0 [10.134.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f1a692-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f1a692-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-dd87f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd87f0: serviceaccount "payload-processing-e2e-ipp-a-dd87f0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-dd87f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-dd87f0: serviceaccount "payload-processing-e2e-ipp-a-dd87f0" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-abc348-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-abc348-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d5625-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d5625-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.156s (3.156s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.272s (2.272s including waiting). Image size: 166620835 bytes.

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f1a692-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-f1a692-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-abc348-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-abc348-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-765fc6594c-276rq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-78b6df7b67-bsvdl

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c

SuccessfulCreate

Created pod: e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

openshift-ingress

deployment-controller

e2e-ipp-b-0809c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0809c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0809c8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-d94cc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-d94cc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-a-6a5285-7df9d5c5b9-zrdcb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6a5285-599746bcc5-9g7ht

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0809c8-64cf8df667

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0809c8-64cf8df667-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0809c8: serviceaccount "payload-processing-e2e-ipp-b-0809c8" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0809c8: serviceaccount "payload-processing-e2e-ipp-b-0809c8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0809c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0809c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0809c8-64cf8df667 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0809c8-64cf8df667

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm

AddedInterface

Add eth0 [10.134.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-045653

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-045653-6b5cfcf4d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-045653

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-045653-7c865bfc67 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-045653-6b5cfcf4d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-045653-6b5cfcf4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-045653: serviceaccount "payload-processing-e2e-ipp-a-045653" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-045653: serviceaccount "payload-processing-e2e-ipp-a-045653" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-045653-6b5cfcf4d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

ProbeError

Startup probe error: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

Unhealthy

Startup probe failed: Get "http://10.134.0.187:15021/healthz/ready": dial tcp 10.134.0.187:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-d94cc3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-d94cc3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-018375-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-018375-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-018375-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-018375-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-abc348

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-abc348-b97879cd4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-778658cdb7-cr9bl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-6b46774f5f-dd49t

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-abc348

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-abc348: serviceaccount "payload-processing-e2e-ipp-a-abc348" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-abc348-b97879cd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-abc348-b97879cd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-abc348: serviceaccount "payload-processing-e2e-ipp-a-abc348" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-abc348-b97879cd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq

AddedInterface

Add eth0 [10.134.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-nmzqt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d5625-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-9d5625-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-398828-openshift-default-5647988965 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulDelete

Deleted pod: e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-pvrnj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-54769b969-tfkvv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-87d7dd87-24dnh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-gnf96

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 10 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-q9rnh

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-q9rnh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-gnf96

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-6a5285-openshift-default-6596676675-lfxqb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0809c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0809c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1a692-5779dfbc9-hx2bh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1a692-769dbb76cf-nm9px

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-018375

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-018375

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-018375-999b4f876 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-018375: serviceaccount "payload-processing-e2e-ipp-b-018375" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-018375-999b4f876

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-018375-999b4f876-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-018375: serviceaccount "payload-processing-e2e-ipp-b-018375" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj

AddedInterface

Add eth0 [10.134.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-018375-999b4f876

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0809c8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-0809c8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-c7sb7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 8 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-c7sb7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 5.146s (5.146s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-69499c4ff9-drtjt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-64cf8df667-gp4jm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-045653-6b5cfcf4d-d85kt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-045653-7c865bfc67-tphl9

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-fmg4r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-zf5k4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-2ktj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-045653-openshift-default-7dfd4bcd69-gjvsx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9d5625

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9d5625-558f54dc9d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9d5625

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d5625: serviceaccount "payload-processing-e2e-ipp-b-9d5625" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d5625-558f54dc9d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9d5625-558f54dc9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9d5625: serviceaccount "payload-processing-e2e-ipp-b-9d5625" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9d5625-558f54dc9d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0809c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0809c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0809c8-5fb6d4f664 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0809c8: serviceaccount "payload-processing-e2e-ipp-b-0809c8" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0809c8: serviceaccount "payload-processing-e2e-ipp-b-0809c8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-csm6n

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-csm6n

openshift-ingress

multus

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9d5625-558f54dc9d-qnzfm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9d5625-58c6cfdff9-l8wn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-e44998-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e44998-openshift-default-6bfcf667b5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-e44998

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-e44998

openshift-ingress

replicaset-controller

e2e-praxis-a-e44998-openshift-default-6bfcf667b5

SuccessfulCreate

Created pod: e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

openshift-ingress

multus

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

AddedInterface

Add eth0 [10.134.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

ProbeError

Readiness probe error: Get "http://10.132.0.105:15021/healthz/ready": read tcp 10.132.0.2:54080->10.132.0.105:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-9d5625-openshift-default-667b78d6c9-m4m78

Unhealthy

Readiness probe failed: Get "http://10.132.0.105:15021/healthz/ready": read tcp 10.132.0.2:54080->10.132.0.105:15021: read: connection reset by peer

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-e44998

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-e44998-55d9d7867c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e44998: serviceaccount "payload-processing-e2e-praxis-a-e44998" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl

AddedInterface

Add eth0 [10.134.0.219/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e44998-55d9d7867c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-e44998-55d9d7867c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e44998: serviceaccount "payload-processing-e2e-praxis-a-e44998" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e44998-55d9d7867c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-e44998

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4

Created

Container created

openshift-ingress

kubelet

e2e-api-b-f1a692-openshift-default-5d6d98688f-wrrc9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-abc348-b97879cd4-b9nkq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-abc348-6fbfd887f5-4zkk2

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-0a04e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-0a04e0

openshift-ingress

replicaset-controller

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957

SuccessfulCreate

Created pod: e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

openshift-ingress

multus

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-0a04e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-0a04e0-openshift-default-76ff7fc957 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-abc348-openshift-default-7bd4495477-kntqs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-0a04e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-0a04e0-5db76b8859 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-0a04e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-0a04e0-5db76b8859

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-0a04e0-5db76b8859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-0a04e0: serviceaccount "payload-processing-e2e-praxis-a-0a04e0" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-0a04e0: serviceaccount "payload-processing-e2e-praxis-a-0a04e0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-0a04e0-5db76b8859

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e44998-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e44998-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-dd87f0-54b67c4cd8-k55c8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-dd87f0-5dbfc776f5-4b62z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-7lxps

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-lpxkv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 7 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-lpxkv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-cdwxx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

ProbeError

Readiness probe error: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-6qhq2

Unhealthy

Readiness probe failed: Get "http://10.134.0.185:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0809c8-66c9f5dbc9-8k2sv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0809c8-5fb6d4f664-fbphk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-0809c8-openshift-default-7dbbd95d5c-xlgwf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-167a01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-167a01

openshift-ingress

deployment-controller

e2e-praxis-a-167a01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-167a01-openshift-default-6b4f5887bf from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-167a01-openshift-default-6b4f5887bf

SuccessfulCreate

Created pod: e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

openshift-ingress

multus

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-167a01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-167a01-7b99c886bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-167a01-7b99c886bc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-167a01-7b99c886bc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-167a01-7b99c886bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-167a01: serviceaccount "payload-processing-e2e-praxis-a-167a01" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-167a01-88474547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-167a01-88474547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-167a01: serviceaccount "payload-processing-e2e-praxis-a-167a01" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-167a01-88474547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-167a01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-167a01-88474547 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-dd87f0-openshift-default-566d797d85-fqvt8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk

AddedInterface

Add eth0 [10.134.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp

AddedInterface

Add eth0 [10.134.0.225/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

ProbeError

Startup probe error: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

Unhealthy

Startup probe failed: Get "http://10.134.0.217:15021/healthz/ready": dial tcp 10.134.0.217:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-018375-6495ddb8c5-r44mj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-018375-999b4f876-v4d8v

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-3d563c-openshift-default-d89cc6645

SuccessfulCreate

Created pod: e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-3d563c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-3d563c

openshift-ingress

multus

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

AddedInterface

Add eth0 [10.133.0.102/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-3d563c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-3d563c-openshift-default-d89cc6645 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e44998-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e44998-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-2912e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-2912e6

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0a04e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0a04e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc

SuccessfulCreate

Created pod: e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

openshift-ingress

multus

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-2912e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-2912e6-openshift-default-77c65cbbfc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-3d563c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-3d563c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-3d563c-79fbbc9545 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3d563c-79fbbc9545

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-3d563c-79fbbc9545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3d563c: serviceaccount "payload-processing-e2e-praxis-b-3d563c" not found
(x6)

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3d563c: serviceaccount "payload-processing-e2e-praxis-b-3d563c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3d563c-79fbbc9545

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9

AddedInterface

Add eth0 [10.134.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8

AddedInterface

Add eth0 [10.134.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-018375-openshift-default-7fbc48965-7mlcx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8

Started

Container started

openshift-ingress

replicaset-controller

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9

SuccessfulCreate

Created pod: e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

openshift-ingress

deployment-controller

e2e-praxis-b-cb56e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-cb56e9-openshift-default-5985fc47d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-cb56e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-cb56e9

openshift-ingress

multus

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2912e6-5468f5d46f

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-2912e6-5468f5d46f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2912e6: serviceaccount "payload-processing-e2e-praxis-a-2912e6" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-2912e6: serviceaccount "payload-processing-e2e-praxis-a-2912e6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-2912e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-2912e6-5468f5d46f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-2912e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-2912e6-5468f5d46f

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw

AddedInterface

Add eth0 [10.134.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp

AddedInterface

Add eth0 [10.134.0.233/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-cb56e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cb56e9: serviceaccount "payload-processing-e2e-praxis-b-cb56e9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-cb56e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-cb56e9: serviceaccount "payload-processing-e2e-praxis-b-cb56e9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97

AddedInterface

Add eth0 [10.134.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-a-1b1008-openshift-default-678bcc8777

SuccessfulCreate

Created pod: e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

openshift-ingress

deployment-controller

e2e-praxis-a-1b1008-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-1b1008-openshift-default-678bcc8777 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-1b1008

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-1b1008

openshift-ingress

multus

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0a04e0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-0a04e0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1b1008: serviceaccount "payload-processing-e2e-praxis-a-1b1008" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-1b1008

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-1b1008

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-1b1008-54d58d85d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1b1008-54d58d85d7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-1b1008-54d58d85d7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-1b1008-54d58d85d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-1b1008: serviceaccount "payload-processing-e2e-praxis-a-1b1008" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb

AddedInterface

Add eth0 [10.133.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1008-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1008-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

Unhealthy

Readiness probe failed: Get "http://10.132.0.113:15021/healthz/ready": read tcp 10.132.0.2:33602->10.132.0.113:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

ProbeError

Readiness probe error: Get "http://10.132.0.113:15021/healthz/ready": read tcp 10.132.0.2:33602->10.132.0.113:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-167a01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-167a01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

Unhealthy

Startup probe failed: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

ProbeError

Startup probe error: Get "http://10.133.0.102:15021/healthz/ready": dial tcp 10.133.0.102:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3d563c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3d563c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-167a01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-167a01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9

SuccessfulCreate

Created pod: e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

openshift-ingress

deployment-controller

e2e-praxis-b-9b06f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-9b06f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-9b06f8

openshift-ingress

multus

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

AddedInterface

Add eth0 [10.133.0.107/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-9b06f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9b06f8: serviceaccount "payload-processing-e2e-praxis-b-9b06f8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-9b06f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-9b06f8-6496f48859 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9b06f8-6496f48859

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-9b06f8-6496f48859

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-9b06f8-6496f48859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-9b06f8: serviceaccount "payload-processing-e2e-praxis-b-9b06f8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3d563c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3d563c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

Unhealthy

Readiness probe failed: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

ProbeError

Readiness probe error: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2912e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2912e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cb56e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-cb56e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-ad96f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-ad96f4

openshift-ingress

deployment-controller

e2e-praxis-b-ad96f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf

SuccessfulCreate

Created pod: e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

openshift-ingress

multus

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2912e6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-2912e6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e44998-55d9d7867c-9sqz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e44998-764fd4f68c-5ggnl

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1008-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-1b1008-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-ad96f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad96f4-5679dbf797

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-ad96f4-5679dbf797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad96f4: serviceaccount "payload-processing-e2e-praxis-b-ad96f4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-ad96f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-ad96f4-5679dbf797 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-ad96f4: serviceaccount "payload-processing-e2e-praxis-b-ad96f4" not found

openshift-ingress

multus

payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-ad96f4-5679dbf797

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-0a04e0-bc9cc6559-cvsjg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-0a04e0-5db76b8859-d6szv

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-f68c7e-openshift-default-db7d68949

SuccessfulCreate

Created pod: e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f68c7e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f68c7e

openshift-ingress

deployment-controller

e2e-praxis-b-f68c7e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f68c7e-openshift-default-db7d68949 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f68c7e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f68c7e-575598759 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f68c7e: serviceaccount "payload-processing-e2e-praxis-b-f68c7e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f68c7e-575598759

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f68c7e-575598759

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f68c7e-575598759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f68c7e: serviceaccount "payload-processing-e2e-praxis-b-f68c7e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f68c7e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs

Created

Container created

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-dmsh8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-e44998-openshift-default-6bfcf667b5-mwgmh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-5lq87

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 3 to 2

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-0a04e0-openshift-default-76ff7fc957-khvzt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d563c-79fbbc9545-sv8h8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d563c-64d4df97cf-v5sg9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-cb56e9-545bcc7cc7-85plw

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

ProbeError

Startup probe error: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

Unhealthy

Startup probe failed: Get "http://10.133.0.107:15021/healthz/ready": dial tcp 10.133.0.107:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-cb56e9-d444d6cbc-vvc97

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9b06f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9b06f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-cb56e9-openshift-default-5985fc47d9-gcs6w

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9b06f8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-9b06f8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

Unhealthy

Startup probe failed: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

ProbeError

Startup probe error: Get "http://10.132.0.118:15021/healthz/ready": dial tcp 10.132.0.118:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad96f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad96f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-167a01-7b99c886bc-k8rsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-167a01-88474547-k8xhk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

Started

Container started

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad96f4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-ad96f4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-3d563c-openshift-default-d89cc6645-zt9kj

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-b-f68c7e-openshift-default-db7d68949

SuccessfulCreate

Created pod: e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

openshift-ingress

multus

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

AddedInterface

Add eth0 [10.133.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-f68c7e-openshift-default-db7d68949

SuccessfulCreate

Created pod: e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

openshift-ingress

multus

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-b-f68c7e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f68c7e-openshift-default-db7d68949 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f68c7e-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

Unhealthy

Readiness probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

ProbeError

Readiness probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

Created

Container created

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

ProbeError

Startup probe error: Get "http://10.134.0.245:15021/healthz/ready": dial tcp 10.134.0.245:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

Unhealthy

Startup probe failed: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

Unhealthy

Startup probe failed: Get "http://10.134.0.245:15021/healthz/ready": dial tcp 10.134.0.245:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

ProbeError

Startup probe error: Get "http://10.133.0.112:15021/healthz/ready": dial tcp 10.133.0.112:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

ProbeError

Startup probe error: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

Unhealthy

Startup probe failed: Get "http://10.132.0.120:15021/healthz/ready": dial tcp 10.132.0.120:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-2912e6-5468f5d46f-czlhp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-2912e6-66887f8d9f-fmjvw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-167a01-openshift-default-6b4f5887bf-wsbxk

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f68c7e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f68c7e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-ca6546-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-ca6546-openshift-default-994bcc7f5 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-ca6546-openshift-default-994bcc7f5

SuccessfulDelete

Deleted pod: e2e-worker-w2-ca6546-openshift-default-994bcc7f5-tpj5j

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-ca6546-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-9b06f8-6496f48859-qhv8d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-9b06f8-b944bb979-4vxw4

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f68c7e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f68c7e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

Started

Container started

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-2912e6-openshift-default-77c65cbbfc-bz4mb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

Unhealthy

Startup probe failed: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

ProbeError

Startup probe error: Get "http://10.132.0.138:15021/healthz/ready": dial tcp 10.132.0.138:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-ad96f4-755fc48bc5-24zch

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-ad96f4-5679dbf797-tt6bq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-b-9b06f8-openshift-default-78cf45cfb9-4rk6d

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

Created

Container created

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

AddedInterface

Add eth0 [10.134.0.247/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

ProbeError

Startup probe error: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

Unhealthy

Startup probe failed: Get "http://10.134.0.247:15021/healthz/ready": dial tcp 10.134.0.247:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-ad96f4-openshift-default-7d4cf57fdf-wknv5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-ee0fed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-ee0fed

openshift-ingress

multus

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

AddedInterface

Add eth0 [10.132.0.155/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f

SuccessfulCreate

Created pod: e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

openshift-ingress

deployment-controller

e2e-shared-a-w0-ee0fed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-a7cf93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-a7cf93

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-7c1bee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-7c1bee

openshift-ingress

deployment-controller

e2e-shared-a-w4-a7cf93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df

SuccessfulCreate

Created pod: e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

openshift-ingress

replicaset-controller

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5

SuccessfulCreate

Created pod: e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

openshift-ingress

deployment-controller

e2e-shared-a-w1-7c1bee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-ee0fed: serviceaccount "payload-processing-e2e-shared-a-w0-ee0fed" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-ee0fed: serviceaccount "payload-processing-e2e-shared-a-w0-ee0fed" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-aad578

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-aad578

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-ee0fed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-ee0fed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

AddedInterface

Add eth0 [10.134.0.253/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-aad578-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-aad578-openshift-default-688f6b55cc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc

SuccessfulCreate

Created pod: e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s

AddedInterface

Add eth0 [10.134.0.254/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

AddedInterface

Add eth0 [10.134.0.255/23] from ovn-kubernetes
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulCreate

Created pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

Started

Container started

openshift-ingress

multus

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

AddedInterface

Add eth0 [10.132.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-a7cf93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-a7cf93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-a7cf93: serviceaccount "payload-processing-e2e-shared-a-w4-a7cf93" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-a7cf93: serviceaccount "payload-processing-e2e-shared-a-w4-a7cf93" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv

AddedInterface

Add eth0 [10.134.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

AddedInterface

Add eth0 [10.134.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

Unhealthy

Startup probe failed: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

ProbeError

Startup probe error: Get "http://10.132.0.157:15021/healthz/ready": dial tcp 10.132.0.157:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-7c1bee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-7c1bee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7c1bee: serviceaccount "payload-processing-e2e-shared-a-w1-7c1bee" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-7c1bee: serviceaccount "payload-processing-e2e-shared-a-w1-7c1bee" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

AddedInterface

Add eth0 [10.134.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 2 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

(combined from similar events): New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulCreate

Created pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulCreate

Created pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-aad578

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-aad578-6d6755f65f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-aad578

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

Created

Container created

openshift-ingress

multus

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

AddedInterface

Add eth0 [10.134.1.4/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-aad578: serviceaccount "payload-processing-e2e-shared-a-w3-aad578" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

AddedInterface

Add eth0 [10.134.1.5/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-aad578: serviceaccount "payload-processing-e2e-shared-a-w3-aad578" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

AddedInterface

Add eth0 [10.134.1.6/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

Unhealthy

Startup probe failed: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

ProbeError

Startup probe error: Get "http://10.134.1.4:15021/healthz/ready": dial tcp 10.134.1.4:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-a7cf93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-a7cf93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-1b1008-54d58d85d7-lxdpb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-1b1008-5bdf9cb9f-pmtjc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

ProbeError

Readiness probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Unhealthy

Readiness probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

ProbeError

Startup probe error: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w0-147104-openshift-default-7c49449cb7

SuccessfulCreate

Created pod: e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-147104

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-147104
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

Unhealthy

Startup probe failed: Get "http://10.134.0.255:15021/healthz/ready": dial tcp 10.134.0.255:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w0-147104-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-147104-openshift-default-7c49449cb7 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-ac7ab4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-ac7ab4

openshift-ingress

deployment-controller

e2e-shared-b-w4-ac7ab4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f

SuccessfulCreate

Created pod: e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-147104

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-147104-869847c6d9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-147104-869847c6d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-147104-869847c6d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-147104: serviceaccount "payload-processing-e2e-shared-b-w0-147104" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-147104: serviceaccount "payload-processing-e2e-shared-b-w0-147104" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-147104

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-147104-869847c6d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-a7cf93-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-a7cf93-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-3b27a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-3b27a5

openshift-ingress

replicaset-controller

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c

SuccessfulCreate

Created pod: e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

openshift-ingress

deployment-controller

e2e-shared-b-w1-3b27a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

ProbeError

Startup probe error: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

Unhealthy

Startup probe failed: Get "http://10.132.0.155:15021/healthz/ready": dial tcp 10.132.0.155:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-ac7ab4: serviceaccount "payload-processing-e2e-shared-b-w4-ac7ab4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-ac7ab4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-ac7ab4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-ac7ab4: serviceaccount "payload-processing-e2e-shared-b-w4-ac7ab4" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-aad578-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-aad578-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-3d14ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-3d14ee
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ee0fed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ee0fed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-3b27a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-3b27a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

Unhealthy

Startup probe failed: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

ProbeError

Startup probe error: Get "http://10.132.0.156:15021/healthz/ready": dial tcp 10.132.0.156:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-3b27a5: serviceaccount "payload-processing-e2e-shared-b-w1-3b27a5" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7

SuccessfulCreate

Created pod: e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

openshift-ingress

deployment-controller

e2e-shared-b-w3-3d14ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-3b27a5: serviceaccount "payload-processing-e2e-shared-b-w1-3b27a5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

openshift-ingress

multus

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-3d14ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3d14ee: serviceaccount "payload-processing-e2e-shared-b-w3-3d14ee" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-aad578-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-aad578-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3d14ee: serviceaccount "payload-processing-e2e-shared-b-w3-3d14ee" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-3d14ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ac7ab4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ac7ab4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-b-f68c7e-openshift-default-db7d68949

SuccessfulDelete

Deleted pod: e2e-praxis-b-f68c7e-openshift-default-db7d68949-slfvh

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f68c7e-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ee0fed-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-praxis-b-f68c7e-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-praxis-b-f68c7e-openshift-default-db7d68949 from 3 to 2
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-ee0fed-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7c1bee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-7c1bee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-1b1008-openshift-default-678bcc8777-8l6rc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-147104-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-147104-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f68c7e-5dcfbcd4c9-lkwsf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f68c7e-575598759-2qcfs

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

ProbeError

Readiness probe error: Get "http://10.133.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Unhealthy

Readiness probe failed: Get "http://10.133.0.121:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-86f4c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-86f4c4-openshift-default-66f6f5bb45 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-86f4c4-openshift-default-66f6f5bb45

SuccessfulCreate

Created pod: e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

openshift-ingress

gateway_labeler_controller

e2e-explicit-86f4c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-86f4c4

openshift-ingress

multus

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-c7q6l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-f68c7e-openshift-default-db7d68949-v6prs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-147104-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-147104-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-86f4c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-86f4c4-6d49ccf78c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-86f4c4: serviceaccount "payload-processing-e2e-explicit-86f4c4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-86f4c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-86f4c4-65798bb56c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-86f4c4-6d49ccf78c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-86f4c4-6d49ccf78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-86f4c4: serviceaccount "payload-processing-e2e-explicit-86f4c4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w

AddedInterface

Add eth0 [10.133.0.125/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-86f4c4-6d49ccf78c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9

openshift-ingress

multus

payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ac7ab4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ac7ab4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-3d14ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-3d14ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-3b27a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-3b27a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-3d14ee-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-3d14ee-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-86f4c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-86f4c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 5 to 4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-94qlz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-56vq7
(x5)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-nm8gk

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-nm8gk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 4 to 3
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-8tv5p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-1f6e39-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-1f6e39-openshift-default-55b56b9965 from 2 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-1f6e39-openshift-default-55b56b9965

SuccessfulDelete

Deleted pod: e2e-worker-w0-1f6e39-openshift-default-55b56b9965-hspts

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-1f6e39-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

Unhealthy

Readiness probe failed: Get "http://10.132.0.156:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

ProbeError

Readiness probe error: Get "http://10.132.0.156:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-t8dbv
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 3 to 2
(x2)

openshift-ingress

kubelet

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-86f4c4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-86f4c4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-xzskx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-86f4c4-65798bb56c-8824w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-86f4c4-6d49ccf78c-m6gv9

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-858236-openshift-default-74fcd64bf5

SuccessfulDelete

Deleted pod: e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

openshift-ingress

gateway_labeler_controller

e2e-noten-00359a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-00359a

openshift-ingress

replicaset-controller

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85

SuccessfulDelete

Deleted pod: e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-858236-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-858236-openshift-default-74fcd64bf5 from 2 to 1

openshift-ingress

kubelet

e2e-explicit-86f4c4-openshift-default-66f6f5bb45-68xln

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-858236-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

deployment-controller

e2e-worker-w1-5ac93f-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-5ac93f-openshift-default-77d76bbd85 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-5ac93f-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-noten-00359a-openshift-default-6764dcd565

SuccessfulCreate

Created pod: e2e-noten-00359a-openshift-default-6764dcd565-4l58q

openshift-ingress

kubelet

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

Created

Container created

openshift-ingress

kubelet

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

Started

Container started

openshift-ingress

deployment-controller

e2e-noten-00359a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-00359a-openshift-default-6764dcd565 from 0 to 1

openshift-ingress

multus

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

AddedInterface

Add eth0 [10.133.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-twfd2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-lwwpm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-00359a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-00359a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-00359a-openshift-default-6764dcd565-4l58q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

multus

test-curl-11259-30a5ee

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11259-30a5ee

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-11259-30a5ee

Started

Container started

opendatahub

kubelet

test-curl-11259-30a5ee

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.743s (2.743s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-11259-30a5ee

Created

Container created

opendatahub

kubelet

test-curl-11259-30a5ee

Killing

Stopping container test-curl-11259-30a5ee

opendatahub

kubelet

test-curl-11259-18b6ec

Created

Container created

opendatahub

kubelet

test-curl-11259-18b6ec

Started

Container started

opendatahub

kubelet

test-curl-11259-18b6ec

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11259-18b6ec

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11259-01a2e3

Started

Container started

opendatahub

kubelet

test-curl-11259-01a2e3

Created

Container created

opendatahub

multus

test-curl-11259-01a2e3

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11259-18b6ec

Killing

Stopping container test-curl-11259-18b6ec

opendatahub

kubelet

test-curl-11259-01a2e3

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11259-e7fc1a

Started

Container started

opendatahub

kubelet

test-curl-11259-e7fc1a

Created

Container created

opendatahub

kubelet

test-curl-11259-01a2e3

Killing

Stopping container test-curl-11259-01a2e3

opendatahub

kubelet

test-curl-11259-e7fc1a

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11259-e7fc1a

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

opendatahub

multus

test-curl-11259-62a0bb

AddedInterface

Add eth0 [10.132.0.182/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11259-e7fc1a

Killing

Stopping container test-curl-11259-e7fc1a

opendatahub

kubelet

test-curl-11259-62a0bb

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11259-62a0bb

Created

Container created

opendatahub

kubelet

test-curl-11259-62a0bb

Started

Container started

opendatahub

kubelet

test-curl-11259-62a0bb

Killing

Stopping container test-curl-11259-62a0bb

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-61c297

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-61c297

openshift-ingress

deployment-controller

e2e-extmod-a-61c297-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-61c297-openshift-default-6b8dc99857 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-61c297-openshift-default-6b8dc99857

SuccessfulCreate

Created pod: e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

openshift-ingress

multus

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

AddedInterface

Add eth0 [10.132.0.183/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9

SuccessfulCreate

Created pod: e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

openshift-ingress

deployment-controller

e2e-extmod-a-9b7f43-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-9b7f43

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-9b7f43

openshift-ingress

multus

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-61c297-6df8d4c95f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-61c297-6df8d4c95f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-61c297: serviceaccount "payload-processing-e2e-extmod-a-61c297" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-61c297-6df8d4c95f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-61c297

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-61c297-6df8d4c95f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-61c297

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-61c297: serviceaccount "payload-processing-e2e-extmod-a-61c297" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-9b7f43

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-9b7f43-8fbfd5769 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9b7f43: serviceaccount "payload-processing-e2e-extmod-a-9b7f43" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-9b7f43

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9b7f43: serviceaccount "payload-processing-e2e-extmod-a-9b7f43" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r

AddedInterface

Add eth0 [10.133.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11262-299ddb

Started

Container started

opendatahub

kubelet

test-curl-11262-299ddb

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11262-299ddb

AddedInterface

Add eth0 [10.134.1.19/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11262-299ddb

Created

Container created

opendatahub

kubelet

test-curl-11262-299ddb

Killing

Stopping container test-curl-11262-299ddb

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ae1315

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ae1315

openshift-ingress

deployment-controller

e2e-extmod-a-ae1315-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ae1315-openshift-default-568d79d5b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-ae1315-openshift-default-568d79d5b5

SuccessfulCreate

Created pod: e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

openshift-ingress

multus

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ae1315: serviceaccount "payload-processing-e2e-extmod-a-ae1315" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ae1315-864c8985d7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ae1315

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ae1315

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ae1315-864c8985d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ae1315-864c8985d7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ae1315-864c8985d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ae1315: serviceaccount "payload-processing-e2e-extmod-a-ae1315" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-11256-c2b7ec

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-11256-c2b7ec

AddedInterface

Add eth0 [10.134.1.20/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-11256-c2b7ec

Created

Container created

opendatahub

kubelet

test-curl-11256-c2b7ec

Started

Container started

opendatahub

kubelet

test-curl-11256-c2b7ec

Killing

Stopping container test-curl-11256-c2b7ec

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-61f3b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-61f3b6

openshift-ingress

deployment-controller

e2e-extmod-a-61f3b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc

SuccessfulCreate

Created pod: e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

openshift-ingress

multus

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-61f3b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-61f3b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-61f3b6-68b7d68447 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-61f3b6: serviceaccount "payload-processing-e2e-extmod-a-61f3b6" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-61f3b6-68b7d68447

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-61f3b6-68b7d68447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-61f3b6: serviceaccount "payload-processing-e2e-extmod-a-61f3b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-61f3b6-68b7d68447

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-autores-e69cf2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-e69cf2-openshift-default-78ffd9b88f from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-e69cf2-openshift-default-78ffd9b88f

SuccessfulCreate

Created pod: e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

openshift-ingress

gateway_labeler_controller

e2e-autores-e69cf2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-e69cf2

openshift-ingress

multus

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-e69cf2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-e69cf2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-e69cf2-795748cc99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e69cf2-795748cc99

SuccessfulCreate

Created pod: payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw

openshift-ingress

multus

payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e69cf2-795748cc99

FailedCreate

Error creating: pods "payload-processing-e2e-autores-e69cf2-795748cc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e69cf2: serviceaccount "payload-processing-e2e-autores-e69cf2" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e69cf2: serviceaccount "payload-processing-e2e-autores-e69cf2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

ProbeError

Readiness probe error: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

Unhealthy

Readiness probe failed: Get "http://10.132.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

ProbeError

Startup probe error: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

Unhealthy

Startup probe failed: Get "http://10.132.0.183:15021/healthz/ready": dial tcp 10.132.0.183:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9b7f43-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9b7f43-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-61c297-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-61c297-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9b7f43-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9b7f43-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ae1315-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ae1315-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61c297-6df8d4c95f-rkt4g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61c297-ddc8b5c4c-j7k75

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ae1315-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ae1315-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9b7f43-665cf654bc-g6jp9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9b7f43-8fbfd5769-xkq9r

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ae1315-864c8985d7-t58sw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ae1315-77b7bbd887-c5cdv

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-61f3b6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-61f3b6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

ProbeError

Startup probe error: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

Unhealthy

Startup probe failed: Get "http://10.132.0.194:15021/healthz/ready": dial tcp 10.132.0.194:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-e69cf2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-e69cf2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-61f3b6-68b7d68447-7fj7w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-61f3b6-67bb8c8755-9t2pk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-61c297-openshift-default-6b8dc99857-xmdbp

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-e69cf2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-e69cf2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-9b7f43-openshift-default-5c6c9c86b9-cz4tf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e69cf2-795748cc99-f2hgw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e69cf2-6b598d9bf9-62jj2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-ee0fed-openshift-default-689c8ff78f-znd9l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-4c3ea5-577dd95747-jqdls

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-4c3ea5-845f45b9c5-s7qg6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-ee0fed-c75c4d6c9-fbd9s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-ee0fed-66c7bc7579-6b2zf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ae1315-openshift-default-568d79d5b5-pd7pn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-147104-869847c6d9-6tsj6

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.120:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-147104-7c757b5c59-lr4pd

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.119:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-a7cf93-7b78677459-fvrpv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-a7cf93-859f5d856c-qgchk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-61f3b6-openshift-default-c7b4bfbfc-cw2x9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-4c3ea5-openshift-default-5b8ddbdc45-sqjsh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-e69cf2-openshift-default-78ffd9b88f-n2bd7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-3f24d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-3f24d0

openshift-ingress

deployment-controller

e2e-extmod-a-3f24d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-3f24d0-openshift-default-6c878989f7 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-3f24d0-openshift-default-6c878989f7

SuccessfulCreate

Created pod: e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

openshift-ingress

multus

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-147104-openshift-default-7c49449cb7-skk7w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-7c1bee-openshift-default-8b9cd95c5-pg8tr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-7c1bee-694764dc5-zrthf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-7c1bee-84b77485bf-9bk69

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-a7cf93-openshift-default-c59cc76df-m8p7l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-3f24d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-3f24d0-79ff68994f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-3f24d0-79ff68994f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3f24d0: serviceaccount "payload-processing-e2e-extmod-a-3f24d0" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-3f24d0-79ff68994f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-3f24d0-79ff68994f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-3f24d0: serviceaccount "payload-processing-e2e-extmod-a-3f24d0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-3f24d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md

AddedInterface

Add eth0 [10.132.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-d94cc3-c65c96ff9-hl57x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-d94cc3-774b67d9f-knmz4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-58847f9fc5 from 1 to 2

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-58847f9fc5-mtpnz
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ac7ab4-7d5c898ff-bgngb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ac7ab4-6b59c4f57f-q4kzp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1f6e39-6d697b7999-7nsr8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1f6e39-69f9854f95-b4c6w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-3b27a5-78dcc69455-xd7nl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-3b27a5-79b5c57585-mgdcp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-d94cc3-openshift-default-5d95d97d45-ldstc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-ac7ab4-openshift-default-66dcc65c6f-bq7hw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-ca6546-76c6c456c9-vxsgp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-ca6546-8d886cbbf-qx4dh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w1-3b27a5-openshift-default-845fbbf48c-mtbc2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-398828-75678b79b7-bbqqw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

Started

Container started
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-398828-54955d6b75-czhwj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-1f6e39-openshift-default-55b56b9965-r9q89

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3f24d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3f24d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-12c92e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-12c92e

openshift-ingress

deployment-controller

e2e-extmod-b-12c92e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-12c92e-openshift-default-6df5f5d7df from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df

SuccessfulCreate

Created pod: e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

openshift-ingress

multus

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

Unhealthy

Startup probe failed: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

ProbeError

Startup probe error: Get "http://10.132.0.220:15021/healthz/ready": dial tcp 10.132.0.220:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-12c92e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-12c92e-77cc49c889 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-12c92e-77cc49c889

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-12c92e-77cc49c889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-12c92e: serviceaccount "payload-processing-e2e-extmod-b-12c92e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-12c92e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-12c92e: serviceaccount "payload-processing-e2e-extmod-b-12c92e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-5ac93f-6578c5846c-lxsjl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-5ac93f-6f67ddfdc5-bwhr4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

multus

payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-12c92e-77cc49c889

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-ca6546-openshift-default-994bcc7f5-xpw6q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-398828-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-398828-openshift-default-5647988965 from 1 to 3

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

AddedInterface

Add eth0 [10.134.1.27/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-398828-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-84v2t

openshift-ingress

replicaset-controller

e2e-worker-w4-398828-openshift-default-5647988965

SuccessfulCreate

Created pod: e2e-worker-w4-398828-openshift-default-5647988965-wld4d

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-84v2t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-84v2t

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-84v2t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-398828-openshift-default-5647988965-84v2t

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-worker-w4-398828-openshift-default-dockercfg-dqq8t); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-84v2t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-ph22f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

ProbeError

Startup probe error: Get "http://10.134.1.27:15021/healthz/ready": dial tcp 10.134.1.27:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-398828-openshift-default-5647988965-wld4d

Unhealthy

Startup probe failed: Get "http://10.134.1.27:15021/healthz/ready": dial tcp 10.134.1.27:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3f24d0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-3f24d0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-5ac93f-openshift-default-77d76bbd85-47pn2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

Unhealthy

Readiness probe failed: Get "http://10.133.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

ProbeError

Readiness probe error: Get "http://10.133.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12c92e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12c92e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12c92e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-12c92e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-3f24d0-79ff68994f-sk2md

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-3f24d0-5cb96cdc8c-6p6b9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-3f24d0-openshift-default-6c878989f7-n2st9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-12c92e-794c95d6c5-xqkjx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-12c92e-77cc49c889-lrmqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-12c92e-openshift-default-6df5f5d7df-frm7j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-aad578-openshift-default-688f6b55cc-qxqmg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-aad578-6d6755f65f-5ljdx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.1.6:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-aad578-c96769d99-2zkf4

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.1.5:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-3d14ee-openshift-default-56d864fcd7-4xm4r

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3d14ee-79cf5597df-r67vv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3d14ee-b7dd4c6b7-c4wvd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-58847f9fc5

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-58847f9fc5-mtpnz
(x2)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-58847f9fc5 from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-58847f9fc5-mtpnz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-858236-5c5788679f-7r9bv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-858236-646789f8d5-hzm6p

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-858236-openshift-default-74fcd64bf5-dvdrt

Killing

Stopping container istio-proxy