Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-111f9c64-759998544b-zkrvk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-111f9c64-759998544b-zkrvk to ip-10-0-134-200.us-west-2.compute.internal

opendatahub

test-curl-7337-952641

Scheduled

Successfully assigned opendatahub/test-curl-7337-952641 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl to ip-10-0-130-34.us-west-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-gpmzl

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p to ip-10-0-131-147.us-west-2.compute.internal

opendatahub

test-curl-7337-1062c2

Scheduled

Successfully assigned opendatahub/test-curl-7337-1062c2 to ip-10-0-134-200.us-west-2.compute.internal

opendatahub

test-curl-7337-a890cc

Scheduled

Successfully assigned opendatahub/test-curl-7337-a890cc to ip-10-0-131-147.us-west-2.compute.internal

opendatahub

test-curl-7334-2f919b

Scheduled

Successfully assigned opendatahub/test-curl-7334-2f919b to ip-10-0-134-200.us-west-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-ljppk to ip-10-0-131-147.us-west-2.compute.internal

opendatahub

test-curl-7331-9798b1

Scheduled

Successfully assigned opendatahub/test-curl-7331-9798b1 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57 to ip-10-0-130-34.us-west-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-sn9t5

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5 to ip-10-0-130-34.us-west-2.compute.internal

opendatahub

test-curl-7325-ff97ce

Scheduled

Successfully assigned opendatahub/test-curl-7325-ff97ce to ip-10-0-134-200.us-west-2.compute.internal

opendatahub

test-curl-7325-8cfa0c

Scheduled

Successfully assigned opendatahub/test-curl-7325-8cfa0c to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl to ip-10-0-131-147.us-west-2.compute.internal

opendatahub

test-curl-7325-768ecc

Scheduled

Successfully assigned opendatahub/test-curl-7325-768ecc to ip-10-0-134-200.us-west-2.compute.internal

opendatahub

test-curl-7325-3e9666

Scheduled

Successfully assigned opendatahub/test-curl-7325-3e9666 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-5f78687d5b-t5gqn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-t5gqn to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 to ip-10-0-130-34.us-west-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-fstjg

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-fstjg to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8 to ip-10-0-130-34.us-west-2.compute.internal

opendatahub

odh-model-controller-769875db56-pc2dt

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-pc2dt to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-6ns9w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6 to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

authorino-57f7f8659f-b8z4n

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-b8z4n to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7

Scheduled

Successfully assigned openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

authorino-5fcd7f7c4-p4ccs

Scheduled

Successfully assigned kuadrant-system/authorino-5fcd7f7c4-p4ccs to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25 to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-wvh89

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-wvh89 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

authorino-7c655d95d5-bjwvw

Scheduled

Successfully assigned kuadrant-system/authorino-7c655d95d5-bjwvw to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s to ip-10-0-131-147.us-west-2.compute.internal

kuadrant-system

authorino-d955c5b5f-7bctz

Scheduled

Successfully assigned kuadrant-system/authorino-d955c5b5f-7bctz to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-b9md6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-b9md6 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-111f9c64-759998544b-n4dkv to ip-10-0-131-147.us-west-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-5r6fq

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-5r6fq to ip-10-0-134-200.us-west-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-x4rdp

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-x4rdp to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-5mm4g

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj to ip-10-0-131-147.us-west-2.compute.internal

opendatahub

maas-controller-7d7f7cf6c4-bcgck

Scheduled

Successfully assigned opendatahub/maas-controller-7d7f7cf6c4-bcgck to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk to ip-10-0-131-147.us-west-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-gz5b9

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-gz5b9 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-j5xnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-j5xnn to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh to ip-10-0-131-147.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-2cmxc to ip-10-0-134-200.us-west-2.compute.internal

opendatahub

maas-controller-6fc6f45d55-zjfj5

Scheduled

Successfully assigned opendatahub/maas-controller-6fc6f45d55-zjfj5 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-q9kwv

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-q9kwv to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6 to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-mthrm

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-vjj8v

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjj8v to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv to ip-10-0-130-34.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-qs7n5

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-qs7n5 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-4vfdh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4vfdh to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-6vdd2

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-6vdd2 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb to ip-10-0-134-200.us-west-2.compute.internal

cert-manager

cert-manager-597b95cb84-shqvm

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-shqvm to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp to ip-10-0-131-147.us-west-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-mfq8q

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-mfq8q to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-859kr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr to ip-10-0-130-34.us-west-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-5hwsq

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-5hwsq to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3df7da3e-openshift-default-5485798879-8x262 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-c4c65fbf-cnvwt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-cnvwt to ip-10-0-134-200.us-west-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-jt8mk

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-jt8mk to ip-10-0-134-200.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-jhwm8 to ip-10-0-131-147.us-west-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-dshrx

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-dshrx to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4 to ip-10-0-131-147.us-west-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-xwf7b

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-xwf7b to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 to ip-10-0-130-34.us-west-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z to ip-10-0-130-34.us-west-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-v9b7q

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-v9b7q to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-5fc9b9cc5d-qz44t

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t to ip-10-0-130-34.us-west-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs to ip-10-0-130-34.us-west-2.compute.internal

opendatahub

ai-gateway-controller-76fc486898-xkrnb

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-76fc486898-xkrnb to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6 to ip-10-0-130-34.us-west-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-b5vhn

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-b5vhn to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

router-default-8598d5bb4c-4xl9z

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-8598d5bb4c-4xl9z

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-8598d5bb4c-4xl9z

Scheduled

Successfully assigned openshift-ingress/router-default-8598d5bb4c-4xl9z to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-mcbsf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-mcbsf to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-p82xp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-p82xp to ip-10-0-134-200.us-west-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-7q7rc

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr to ip-10-0-134-200.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-7f9f45fffd-z2xgj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs to ip-10-0-131-147.us-west-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-659b74b5cf-9s48t

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-rmnvr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-rmnvr to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j to ip-10-0-130-34.us-west-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-qqqrm

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-qqqrm to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-79c649-5cf6767768-nl4l6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

Scheduled

Successfully assigned openshift-ingress/e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2 to ip-10-0-130-34.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-7f9f45fffd-pq8mg

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd to ip-10-0-130-34.us-west-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz to ip-10-0-130-34.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-788b6c6b4d-59ggs

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-788b6c6b4d-59ggs to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l to ip-10-0-130-34.us-west-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-6zjkp

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-6zjkp to ip-10-0-130-34.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-5dc946644f-sxthh

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5dc946644f-sxthh to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-mj77z

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-mj77z to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-tzs66

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-tzs66 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-lvnj7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-lvnj7 to ip-10-0-131-147.us-west-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-qqwkz

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-qqwkz to ip-10-0-131-147.us-west-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-kkb9c

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k to ip-10-0-131-147.us-west-2.compute.internal

models-as-a-service

payload-processing-external-model-596cf5558c-jj48j

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-596cf5558c-jj48j to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-cr258 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-585635-5598c7d4d-f4982

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-585635-5598c7d4d-f4982 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

kube-auth-proxy-5fc9b9cc5d-nft4n

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5fc9b9cc5d-nft4n to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5 to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-lfxgm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-lfxgm to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx to ip-10-0-134-200.us-west-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5 to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-zqnbt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-kr46d

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-kr46d to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-fpsfd

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-fpsfd to ip-10-0-134-200.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-8shs8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8 to ip-10-0-130-34.us-west-2.compute.internal

openshift-ingress

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-694db55c87-8nrtp

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8nrtp to ip-10-0-131-147.us-west-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8598d5bb4c from 0 to 1

openshift-ingress

replicaset-controller

router-default-8598d5bb4c

FailedCreate

Error creating: pods "router-default-8598d5bb4c-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range

openshift-ingress

replicaset-controller

router-default-8598d5bb4c

SuccessfulCreate

Created pod: router-default-8598d5bb4c-4xl9z

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x2)

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 500

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

ProbeError

Startup probe error: HTTP probe failed with statuscode: 500 body: [-]backend-proxy-http failed: reason withheld [+]has-synced ok [+]process-running ok healthz check failed

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

Started

Container started

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

Created

Container created

openshift-ingress

kubelet

router-default-8598d5bb4c-4xl9z

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-8598d5bb4c-4xl9z

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-qqwkz

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-qqwkz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-qqwkz

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-qqwkz

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-qqwkz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.337s (4.337s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-qqwkz

Started

Container started

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 0 to 1

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-856cdd999f from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-856cdd999f

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-mcbsf

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-mcbsf

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 9.297s (9.297s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg

Started

Container started

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-856cdd999f-k4nlg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 10.216s (10.216s including waiting). Image size: 183555333 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-f84ddd5d6 from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-f84ddd5d6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-f84ddd5d6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-f84ddd5d6-plb6z

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-f84ddd5d6

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.609s (3.609s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 4.293s (4.293s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.792s (3.792s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 881ms (881ms including waiting). Image size: 273709574 bytes.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-2b2m5

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-plb6z

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 882ms (882ms including waiting). Image size: 273709574 bytes.
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 776ms (776ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-2cmxc

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-f84ddd5d6-jhwm8

Started

Container started

opendatahub-operator-system

opendatahub-operator-controller-manager-f84ddd5d6-plb6z_e1814f21-e967-495d-b57f-657bb7eb40a1

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-f84ddd5d6-plb6z_e1814f21-e967-495d-b57f-657bb7eb40a1 became leader
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-sn9t5

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-sn9t5

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-sn9t5

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
(x9)

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

FailedCreate

Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-gpmzl

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-gpmzl

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-gpmzl

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-5r6fq

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

multus

authorino-operator-7b7bb4bc77-5r6fq

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-5r6fq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-gpmzl

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.914s (2.914s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-sn9t5

Started

Container started

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-sn9t5

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-sn9t5

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 4.723s (4.724s including waiting). Image size: 309650901 bytes.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-gpmzl

Created

Container created

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-gpmzl

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-jt8mk

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-kkb9c

kuadrant-system

authorino-operator-7b7bb4bc77-5r6fq_92ebcbe0-c903-46d8-bdf8-98b2e20f37a5

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-5r6fq_92ebcbe0-c903-46d8-bdf8-98b2e20f37a5 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-5r6fq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.547s (3.547s including waiting). Image size: 167738465 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-5r6fq

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-5r6fq

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-jt8mk

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-kkb9c

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-kkb9c

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-jt8mk

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x12)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-jt8mk

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-jt8mk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.443s (2.443s including waiting). Image size: 177967631 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-jt8mk

Created

Container created

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-gz5b9

kuadrant-system

limitador-operator-controller-manager-5778bb4449-jt8mk_c4372b6f-fbbe-46e6-8185-fec63619b12e

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-jt8mk_c4372b6f-fbbe-46e6-8185-fec63619b12e became leader

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-gz5b9

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-kkb9c

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 4.046s (4.046s including waiting). Image size: 224874686 bytes.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-kkb9c

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gz5b9

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-kkb9c

Started

Container started

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-kkb9c_c515ab31-9c57-45a7-a5f1-aa38aa78753e became leader

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gz5b9

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gz5b9

Started

Container started

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-gz5b9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.769s (2.769s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-gz5b9_e7c0427f-6fac-4a82-b4d8-118af7b69436

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-gz5b9_e7c0427f-6fac-4a82-b4d8-118af7b69436 became leader

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-vjj8v

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-vjj8v

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-vjj8v

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-shqvm

cert-manager

multus

cert-manager-597b95cb84-shqvm

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-shqvm

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-shqvm

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-shqvm

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-vjj8v

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.289s (5.29s including waiting). Image size: 424244516 bytes.

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-vjj8v

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-vjj8v

Created

Container created

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-crngs"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-5w6jq"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-vjj8v_b2197fb6-0355-4433-9868-7825acf46d10

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-vjj8v_b2197fb6-0355-4433-9868-7825acf46d10 became leader

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-c4c65fbf from 0 to 1

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5fc9b9cc5d from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5fc9b9cc5d

SuccessfulCreate

Created pod: kube-auth-proxy-5fc9b9cc5d-qz44t

openshift-ingress

replicaset-controller

kube-auth-proxy-5fc9b9cc5d

SuccessfulCreate

Created pod: kube-auth-proxy-5fc9b9cc5d-nft4n

openshift-ingress

multus

kube-auth-proxy-5fc9b9cc5d-nft4n

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-c4c65fbf

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-c4c65fbf-cnvwt

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-qz44t

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-5fc9b9cc5d-qz44t

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-nft4n

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-c4c65fbf-cnvwt

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c4c65fbf-cnvwt

Started

Container started

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c4c65fbf-cnvwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-c4c65fbf-cnvwt

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-nft4n

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-qz44t

Started

Container started

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-659b74b5cf from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-nft4n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.804s (2.804s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-nft4n

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-qz44t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.006s (3.006s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5fc9b9cc5d-qz44t

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-659b74b5cf

SuccessfulCreate

Created pod: jobset-controller-manager-659b74b5cf-9s48t

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

multus

jobset-controller-manager-659b74b5cf-9s48t

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-6vdd2

openshift-jobset-operator

kubelet

jobset-controller-manager-659b74b5cf-9s48t

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-b8z4n

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6vdd2

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

multus

limitador-limitador-74dfcfb894-6vdd2

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

kuadrant-system

multus

authorino-57f7f8659f-b8z4n

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-57f7f8659f-b8z4n

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-jobset-operator

kubelet

jobset-controller-manager-659b74b5cf-9s48t

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 4.214s (4.214s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-659b74b5cf-9s48t

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-659b74b5cf-9s48t

Started

Container started

openshift-jobset-operator

jobset-controller-manager-659b74b5cf-9s48t_8b8cd9eb-e89a-41e1-b73c-9c653d2137ee

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-659b74b5cf-9s48t_8b8cd9eb-e89a-41e1-b73c-9c653d2137ee became leader

kuadrant-system

kubelet

authorino-57f7f8659f-b8z4n

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-fstjg

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6vdd2

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 4.192s (4.192s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6vdd2

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6vdd2

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-q9kwv

kuadrant-system

multus

authorino-56c6c9ddd5-fstjg

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-7c9b87d574-mfq8q

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-mfq8q

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-mfq8q

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-fstjg

kuadrant-system

kubelet

authorino-57f7f8659f-b8z4n

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.492s (2.492s including waiting). Image size: 204096810 bytes.

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-b8z4n

Created

Container created

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-q9kwv

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-q9kwv

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-mthrm

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

kubelet

authorino-56c6c9ddd5-fstjg

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-fstjg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.311s (1.311s including waiting). Image size: 204096810 bytes.

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-dshrx

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-mfq8q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.052s (2.052s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-fstjg

Created

Container created
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-mthrm

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-mfq8q

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-b8z4n

Killing

Stopping container authorino

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-dshrx

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-mfq8q

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-dshrx

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-b8z4n

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-mthrm

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-dshrx

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-dshrx

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-dshrx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.276s (2.276s including waiting). Image size: 195729000 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-q9kwv

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-q9kwv

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-q9kwv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 6.421s (6.421s including waiting). Image size: 342538866 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-mthrm

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-mthrm

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-mthrm

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 5.153s (5.153s including waiting). Image size: 424244516 bytes.

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-6vdd2

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-6vdd2

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-vjj8v

Killing

Stopping container manager

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-vjj8v

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-dshrx_37c4e5c7-5714-4b88-86ef-d512b230af6b

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-dshrx_37c4e5c7-5714-4b88-86ef-d512b230af6b became leader

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-mthrm_999f09b8-a35c-4219-bef4-833e76c1c586

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-mthrm_999f09b8-a35c-4219-bef4-833e76c1c586 became leader
(x3)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

maas-controller-6fc6f45d55-zjfj5

FailedMount

MountVolume.SetUp failed for volume "webhook-cert" : secret "maas-controller-webhook-cert" not found

opendatahub

replicaset-controller

maas-controller-6fc6f45d55

SuccessfulCreate

Created pod: maas-controller-6fc6f45d55-zjfj5

opendatahub

replicaset-controller

maas-controller-7d7f7cf6c4

SuccessfulCreate

Created pod: maas-controller-7d7f7cf6c4-bcgck

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6fc6f45d55 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-7d7f7cf6c4 from 0 to 1

opendatahub

multus

maas-controller-6fc6f45d55-zjfj5

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6fc6f45d55-zjfj5

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:b56a2a175d569883e1a124fd1aa0c6f4e432e94ec6cabe09a9f23ef958761f7c"

opendatahub

multus

maas-controller-7d7f7cf6c4-bcgck

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-7d7f7cf6c4-bcgck

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:b56a2a175d569883e1a124fd1aa0c6f4e432e94ec6cabe09a9f23ef958761f7c"

opendatahub

kubelet

maas-controller-7d7f7cf6c4-bcgck

Created

Container created

opendatahub

kubelet

maas-controller-6fc6f45d55-zjfj5

Created

Container created

opendatahub

kubelet

maas-controller-7d7f7cf6c4-bcgck

Started

Container started

opendatahub

kubelet

maas-controller-7d7f7cf6c4-bcgck

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b56a2a175d569883e1a124fd1aa0c6f4e432e94ec6cabe09a9f23ef958761f7c" in 6.228s (6.228s including waiting). Image size: 200094735 bytes.

opendatahub

kubelet

maas-controller-6fc6f45d55-zjfj5

Started

Container started

opendatahub

kubelet

maas-controller-6fc6f45d55-zjfj5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:b56a2a175d569883e1a124fd1aa0c6f4e432e94ec6cabe09a9f23ef958761f7c" in 6.219s (6.219s including waiting). Image size: 200094735 bytes.

opendatahub

maas-controller-7d7f7cf6c4-bcgck_417fe53a-830a-4d8e-9b92-dcbc0691247f

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-7d7f7cf6c4-bcgck_417fe53a-830a-4d8e-9b92-dcbc0691247f became leader

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

FailedMount

MountVolume.SetUp failed for volume "proxy-source" : configmap "usage-tenancy-proxy-source" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-ljppk

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-b9md6

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9md6

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9md6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-b9md6

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9md6

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9md6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-b9md6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-qqwkz

Unhealthy

Readiness probe failed: Get "http://10.133.0.18:8080/ready": dial tcp 10.133.0.18:8080: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-qqwkz

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-qqwkz

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-qqwkz

ProbeError

Readiness probe error: Get "http://10.133.0.18:8080/ready": dial tcp 10.133.0.18:8080: connect: connection refused body:

opendatahub

replicaset-controller

maas-controller-6fc6f45d55

SuccessfulDelete

Deleted pod: maas-controller-6fc6f45d55-zjfj5

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-6fc6f45d55 from 1 to 0

opendatahub

kubelet

maas-controller-6fc6f45d55-zjfj5

Killing

Stopping container manager

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-xwf7b

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-pc2dt

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-x4rdp

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-qs7n5

opendatahub

multus

kserve-controller-manager-776cc66d47-xwf7b

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

multus

odh-model-controller-769875db56-pc2dt

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xwf7b

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

odh-model-controller-769875db56-pc2dt

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-qs7n5

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

opendatahub

multus

model-serving-api-75bd89fdfc-x4rdp

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-qs7n5

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

model-serving-api-75bd89fdfc-x4rdp

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

kubelet

model-serving-api-75bd89fdfc-x4rdp

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-qs7n5

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-qs7n5

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-qs7n5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.801s (2.801s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-x4rdp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.87s (2.87s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-x4rdp

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-pc2dt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.775s (3.775s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xwf7b

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-pc2dt

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-pc2dt

Created

Container created

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xwf7b

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 3.952s (3.952s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xwf7b

Started

Container started

opendatahub

kserve-controller-manager-776cc66d47-xwf7b_03d961e6-bd05-4439-bbf1-a2d68bc796f3

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-xwf7b_03d961e6-bd05-4439-bbf1-a2d68bc796f3 became leader

opendatahub

odh-model-controller-769875db56-pc2dt_ea002c68-58d6-4b76-b08d-381a54e3c6c4

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-pc2dt_ea002c68-58d6-4b76-b08d-381a54e3c6c4 became leader

opendatahub

llmisvc-controller-manager-869d5dcc5d-qs7n5_d2636a4e-414e-4cdf-8d8b-9944f8a7247c

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-qs7n5_d2636a4e-414e-4cdf-8d8b-9944f8a7247c became leader
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 17.147s (17.147s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-ljppk

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-wvh89

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-wvh89

kuadrant-system

replicaset-controller

authorino-d955c5b5f

SuccessfulCreate

Created pod: authorino-d955c5b5f-7bctz

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-d955c5b5f from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-d955c5b5f from 1 to 0

kuadrant-system

replicaset-controller

authorino-7c655d95d5

SuccessfulCreate

Created pod: authorino-7c655d95d5-bjwvw

kuadrant-system

replicaset-controller

authorino-d955c5b5f

SuccessfulDelete

Deleted pod: authorino-d955c5b5f-7bctz

kuadrant-system

kubelet

authorino-d955c5b5f-7bctz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7c655d95d5 from 0 to 1

kuadrant-system

multus

authorino-7c655d95d5-bjwvw

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

kuadrant-system

multus

authorino-d955c5b5f-7bctz

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6f6944bcdd-wvh89

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6f6944bcdd-wvh89

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

Created

Container created
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

Started

Container started

kuadrant-system

kubelet

authorino-7c655d95d5-bjwvw

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-d955c5b5f-7bctz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.466s (1.466s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6f6944bcdd-wvh89

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-fstjg

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-fstjg

kuadrant-system

kubelet

authorino-7c655d95d5-bjwvw

Created

Container created

kuadrant-system

kubelet

authorino-7c655d95d5-bjwvw

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.312s (1.312s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-7c655d95d5-bjwvw

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-6f6944bcdd-wvh89

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-6f6944bcdd-wvh89

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.758s (1.758s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-d955c5b5f-7bctz

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-d955c5b5f-7bctz

Started

Container started

kuadrant-system

kubelet

authorino-d955c5b5f-7bctz

Created

Container created

kuadrant-system

kubelet

authorino-6f6944bcdd-wvh89

Created

Container created
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

llmisvc-controller-manager-6466c554d8-5hwsq

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-5hwsq

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5hwsq

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5hwsq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 760ms (760ms including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5hwsq

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-5hwsq

Created

Container created

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-qs7n5

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-qs7n5

Killing

Stopping container manager

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

multus

ai-gateway-controller-7d85675f98-v9b7q

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-v9b7q

opendatahub

kubelet

ai-gateway-controller-7d85675f98-v9b7q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

ai-gateway-controller-7d85675f98-v9b7q_0890d68b-b4fb-4558-8f71-7fb82ff362ea

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-v9b7q_0890d68b-b4fb-4558-8f71-7fb82ff362ea became leader

opendatahub

kubelet

ai-gateway-controller-7d85675f98-v9b7q

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-v9b7q

Started

Container started

opendatahub

kubelet

ai-gateway-controller-7d85675f98-v9b7q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 4.387s (4.387s including waiting). Image size: 183926184 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-j5xnn

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-t5gqn

openshift-ingress

multus

payload-pre-processing-7b98bb678c-j5xnn

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-t5gqn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-5f78687d5b-t5gqn

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j5xnn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-5f78687d5b-t5gqn

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-t5gqn

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-t5gqn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.512s (3.512s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j5xnn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.751s (3.751s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j5xnn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-j5xnn

Started

Container started

opendatahub

replicaset-controller

ai-gateway-controller-76fc486898

SuccessfulCreate

Created pod: ai-gateway-controller-76fc486898-xkrnb

opendatahub

multus

ai-gateway-controller-76fc486898-xkrnb

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-76fc486898 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-76fc486898-xkrnb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

llmisvc-controller-manager-6466c554d8-5hwsq_23f3784f-2860-4042-b791-91811ba99b4f

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-5hwsq_23f3784f-2860-4042-b791-91811ba99b4f became leader

opendatahub

kubelet

ai-gateway-controller-76fc486898-xkrnb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 833ms (833ms including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-76fc486898-xkrnb

Started

Container started

opendatahub

kubelet

ai-gateway-controller-76fc486898-xkrnb

Created

Container created

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-v9b7q

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-v9b7q

Killing

Stopping container manager

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.26s (2.26s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9

Started

Container started

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-w5ns9

Created

Container created

opendatahub

ai-gateway-controller-76fc486898-xkrnb_e99e3195-d1f6-452e-95c7-7be846e7eb9e

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-76fc486898-xkrnb_e99e3195-d1f6-452e-95c7-7be846e7eb9e became leader

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-b5vhn

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-b5vhn

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-b5vhn

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-b5vhn

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-b5vhn

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-b5vhn

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 642ms (642ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-7q7rc

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7q7rc

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-7q7rc

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7q7rc

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7q7rc

Created

Container created

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-7q7rc

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.599s (1.599s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-qqqrm

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qqqrm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-qqqrm

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qqqrm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 638ms (638ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qqqrm

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-qqqrm

Created

Container created

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd

Created

Container created

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 615ms (615ms including waiting). Image size: 98346788 bytes.

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 1 to 3

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-kr46d

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-6ns9w

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-6zjkp

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-6ns9w

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

multus

echo-simulator-kserve-64b6f8f96c-6zjkp

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-6zjkp

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-kr46d

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

echo-simulator-kserve-64b6f8f96c-6zjkp

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.388s (2.388s including waiting). Image size: 78208878 bytes.

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-6zjkp

Started

Container started

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-6zjkp

Created

Container created

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.133s (4.133s including waiting). Image size: 183555333 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh

Created

Container created

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-8jfsh

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 818ms (818ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.926s (5.926s including waiting). Image size: 183555333 bytes.

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 618ms (618ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Started

Container started
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

kuadrant-system

replicaset-controller

authorino-5fcd7f7c4

SuccessfulCreate

Created pod: authorino-5fcd7f7c4-p4ccs

kuadrant-system

multus

authorino-5fcd7f7c4-p4ccs

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5fcd7f7c4-p4ccs

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

kubelet

authorino-5fcd7f7c4-p4ccs

Created

Container created

kuadrant-system

kubelet

authorino-5fcd7f7c4-p4ccs

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.216s (2.216s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-5fcd7f7c4-p4ccs

Started

Container started

kuadrant-system

kubelet

authorino-7c655d95d5-bjwvw

Killing

Stopping container authorino
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-7c655d95d5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-7c655d95d5

SuccessfulDelete

Deleted pod: authorino-7c655d95d5-bjwvw

openshift-ingress

gateway_labeler_controller

e2e-migrate-f214434c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f214434c-gw

openshift-ingress

gateway_labeler_controller

e2e-ait-3df7da3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3df7da3e

openshift-ingress

replicaset-controller

e2e-ait-3df7da3e-openshift-default-5485798879

SuccessfulCreate

Created pod: e2e-ait-3df7da3e-openshift-default-5485798879-8x262

openshift-ingress

deployment-controller

e2e-ait-3df7da3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3df7da3e-openshift-default-5485798879 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-87e6ae88-openshift-default-6fc5bd8df

SuccessfulCreate

Created pod: e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

openshift-ingress

deployment-controller

e2e-ait-87e6ae88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-87e6ae88-openshift-default-6fc5bd8df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-87e6ae88

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-87e6ae88

openshift-ingress

multus

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-f214434c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f214434c-gw-openshift-default-58f59df989 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-f214434c-gw-openshift-default-58f59df989

SuccessfulCreate

Created pod: e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

openshift-ingress

gateway_labeler_controller

e2e-ait-5442f600

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5442f600

openshift-ingress

deployment-controller

e2e-ait-5442f600-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5442f600-openshift-default-7ff99c56cf from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-5442f600-openshift-default-7ff99c56cf

SuccessfulCreate

Created pod: e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

openshift-ingress

multus

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3df7da3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3df7da3e-f59758d8d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3df7da3e-f59758d8d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3df7da3e-f59758d8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3df7da3e: serviceaccount "payload-processing-e2e-ait-3df7da3e" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3df7da3e: serviceaccount "payload-processing-e2e-ait-3df7da3e" not found

openshift-ingress

gateway_labeler_controller

e2e-derive-be15b010

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-be15b010

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3df7da3e-f59758d8d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3df7da3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747 from 0 to 1

openshift-ingress

deployment-controller

e2e-derive-be15b010-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-be15b010-openshift-default-78cc9bcbbf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

e2e-derive-be15b010-openshift-default-78cc9bcbbf

SuccessfulCreate

Created pod: e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

openshift-ingress

multus

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

multus

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.762s (2.762s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-87e6ae88

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-87e6ae88-dd69676cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-87e6ae88: serviceaccount "payload-processing-e2e-ait-87e6ae88" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-87e6ae88-65fb98d7bb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn

openshift-ingress

deployment-controller

payload-processing-e2e-ait-87e6ae88

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-87e6ae88-65fb98d7bb from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-87e6ae88-65fb98d7bb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-87e6ae88-65fb98d7bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-87e6ae88: serviceaccount "payload-processing-e2e-ait-87e6ae88" not found

openshift-ingress

multus

payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f214434c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f214434c-76498c984b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f214434c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f214434c: serviceaccount "payload-processing-e2e-migrate-f214434c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f214434c-76498c984b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f214434c-76498c984b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f214434c-76498c984b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f214434c: serviceaccount "payload-processing-e2e-migrate-f214434c" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5442f600: serviceaccount "payload-processing-e2e-ait-5442f600" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5442f600-579bc8b864

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5442f600-579bc8b864-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5442f600: serviceaccount "payload-processing-e2e-ait-5442f600" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5442f600

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5442f600-579bc8b864 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5442f600

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5442f600-85fc7c58b7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5442f600-579bc8b864

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj

openshift-ingress

multus

payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.801s (2.801s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.86s (2.86s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-be15b010-85c96c9ff6

SuccessfulCreate

Created pod: payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-be15b010

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-be15b010-784fb446ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-be15b010-784fb446ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-be15b010-784fb446ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-be15b010-784fb446ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-be15b010: serviceaccount "payload-processing-e2e-derive-be15b010" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-be15b010-85c96c9ff6

FailedCreate

Error creating: pods "payload-processing-e2e-derive-be15b010-85c96c9ff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-be15b010: serviceaccount "payload-processing-e2e-derive-be15b010" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-be15b010

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-be15b010-85c96c9ff6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26

Started

Container started

openshift-ingress

multus

payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

ProbeError

Readiness probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

Unhealthy

Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-87e6ae88-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-87e6ae88-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87e6ae88-dd69676cf-h2jvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-87e6ae88-65fb98d7bb-55ggn

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f214434c-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f214434c-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-5442f600-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-5442f600-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-5442f600-579bc8b864-jmxbq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5442f600-85fc7c58b7-nvtwj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3df7da3e-7f9b7b6747-5hgcj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-4ec609-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4ec609-openshift-default-66fc5976ff from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulCreate

Created pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a74d15

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a74d15

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-4ec609

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-4ec609

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

openshift-ingress

multus

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.35:50052" within 1s: context deadline exceeded
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3df7da3e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3df7da3e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f214434c-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-f214434c-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-migrate-f214434c-76498c984b-zp2wr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f214434c-6bf6bf9c9-fdn7v

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a74d15

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a74d15-d9bf795c4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a74d15

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a74d15: serviceaccount "payload-processing-e2e-worker-w0-a74d15" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a74d15-d9bf795c4

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a74d15-d9bf795c4

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a74d15-d9bf795c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a74d15: serviceaccount "payload-processing-e2e-worker-w0-a74d15" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-be15b010-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-be15b010-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-4ec609

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-4ec609-f6cc8cb56 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4ec609: serviceaccount "payload-processing-e2e-worker-w4-4ec609" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-4ec609

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4ec609: serviceaccount "payload-processing-e2e-worker-w4-4ec609" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-be15b010-784fb446ff-vvn26

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

Started

Container started

openshift-ingress

kubelet

e2e-ait-3df7da3e-openshift-default-5485798879-8x262

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-b0a183

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-b0a183

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-be15b010-85c96c9ff6-bx7tr

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.34:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-b0a183

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-b0a183: serviceaccount "payload-processing-e2e-worker-w2-b0a183" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-b0a183

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-b0a183-5f4f79ff84 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-b0a183: serviceaccount "payload-processing-e2e-worker-w2-b0a183" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-f214434c-gw-openshift-default-58f59df989-pvzs7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 0 to 1

openshift-ingress

kubelet

e2e-derive-be15b010-openshift-default-78cc9bcbbf-mbmxt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-bbfa07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-bbfa07

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-98a19b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-98a19b

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 0 to 1

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-bbfa07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-bbfa07: serviceaccount "payload-processing-e2e-worker-w3-bbfa07" not found
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-bbfa07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-bbfa07-5d784fb568 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-bbfa07-5d784fb568

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-bbfa07-5d784fb568-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-bbfa07: serviceaccount "payload-processing-e2e-worker-w3-bbfa07" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-bbfa07-5d784fb568

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-98a19b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-98a19b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-98a19b-779f877d8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-98a19b: serviceaccount "payload-processing-e2e-worker-w1-98a19b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-98a19b-779f877d8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-98a19b-779f877d8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-98a19b-779f877d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-98a19b: serviceaccount "payload-processing-e2e-worker-w1-98a19b" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 1 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n
(x2)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

Started

Container started

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

Started

Container started

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 4 to 8

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 1 to 2

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

Started

Container started

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

Created

Container created

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-788b6c6b4d from 0 to 1
(x8)

models-as-a-service

replicaset-controller

payload-processing-external-model-788b6c6b4d

FailedCreate

Error creating: pods "payload-processing-external-model-788b6c6b4d-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-788b6c6b4d

SuccessfulCreate

Created pod: payload-processing-external-model-788b6c6b4d-59ggs

models-as-a-service

multus

payload-processing-external-model-788b6c6b4d-59ggs

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-788b6c6b4d-59ggs

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-788b6c6b4d-59ggs

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-788b6c6b4d-59ggs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-4ec609-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4ec609-openshift-default-66fc5976ff from 1 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulCreate

Created pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

Started

Container started

openshift-ingress

multus

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-5dc946644f

SuccessfulCreate

Created pod: payload-processing-external-model-5dc946644f-sxthh

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5dc946644f from 0 to 1

models-as-a-service

multus

payload-processing-external-model-5dc946644f-sxthh

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5dc946644f-sxthh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5dc946644f-sxthh

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-5dc946644f-sxthh

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 3 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-tzs66

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-tzs66

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-lvnj7

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-5mm4g

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 4 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-5mm4g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-rmnvr

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-rmnvr

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-859kr

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-859kr

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-lvnj7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

Started

Container started
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

Created

Container created

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 8 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-694db55c87-4vfdh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-8nrtp

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-4vfdh

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-8nrtp

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Started

Container started

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

Created

Container created
(x4)

models-as-a-service

kubelet

payload-processing-external-model-788b6c6b4d-59ggs

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-294332af605e" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Unhealthy

Startup probe failed: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

ProbeError

Startup probe error: Get "http://10.132.0.104:15021/healthz/ready": dial tcp 10.132.0.104:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x10)

models-as-a-service

kubelet

payload-processing-external-model-5dc946644f-sxthh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-5dc946644f-sxthh

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-7f9f45fffd

SuccessfulCreate

Created pod: payload-processing-external-model-7f9f45fffd-pq8mg

models-as-a-service

replicaset-controller

payload-processing-external-model-5dc946644f

SuccessfulDelete

Deleted pod: payload-processing-external-model-5dc946644f-sxthh

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5dc946644f from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-pq8mg

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-pq8mg

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-pq8mg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-7f9f45fffd-pq8mg

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x4)

models-as-a-service

kubelet

payload-processing-external-model-788b6c6b4d-59ggs

FailedMount

MountVolume.SetUp failed for volume "provider-credentials" : secret "agc-cred-449cc5558c4a" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 6 to 8

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

Created

Container created

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 2 to 4

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

Unhealthy

Startup probe failed: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

ProbeError

Startup probe error: Get "http://10.132.0.106:15021/healthz/ready": dial tcp 10.132.0.106:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-596cf5558c-jj48j

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

models-as-a-service

replicaset-controller

payload-processing-external-model-7f9f45fffd

SuccessfulDelete

Deleted pod: payload-processing-external-model-7f9f45fffd-pq8mg

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-596cf5558c from 0 to 1

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-7f9f45fffd from 1 to 0
(x9)

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-pq8mg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-pq8mg

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-596cf5558c

SuccessfulCreate

Created pod: payload-processing-external-model-596cf5558c-jj48j

models-as-a-service

kubelet

payload-processing-external-model-596cf5558c-jj48j

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-596cf5558c-jj48j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-596cf5558c-jj48j

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-788b6c6b4d from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-788b6c6b4d

SuccessfulDelete

Deleted pod: payload-processing-external-model-788b6c6b4d-59ggs

models-as-a-service

kubelet

payload-processing-external-model-788b6c6b4d-59ggs

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 2 to 3

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

Started

Container started

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

Unhealthy

Startup probe failed: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

ProbeError

Startup probe error: Get "http://10.132.0.113:15021/healthz/ready": dial tcp 10.132.0.113:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-7f9f45fffd

SuccessfulCreate

Created pod: payload-processing-external-model-7f9f45fffd-z2xgj
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-7f9f45fffd from 0 to 1

models-as-a-service

multus

payload-processing-external-model-7f9f45fffd-z2xgj

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-z2xgj

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-z2xgj

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-z2xgj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 4 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-z2xgj

Killing

Stopping container payload-processing
(x2)

models-as-a-service

kubelet

payload-processing-external-model-7f9f45fffd-z2xgj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

models-as-a-service

kubelet

payload-processing-external-model-596cf5558c-jj48j

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

ProbeError

Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Unhealthy

Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Started

Container started

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 5 to 7

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Unhealthy

Readiness probe failed: Get "http://10.132.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

ProbeError

Readiness probe error: Get "http://10.132.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": dial tcp 10.132.0.126:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

Unhealthy

Startup probe failed: Get "http://10.132.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

ProbeError

Startup probe error: Get "http://10.132.0.126:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 7 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

Started

Container started

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Unhealthy

Liveness probe failed: Get "https://10.132.0.63:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Unhealthy

Readiness probe failed: Get "https://10.132.0.63:8000/ready": context deadline exceeded
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Unhealthy

Liveness probe failed: Get "https://10.132.0.63:8000/health": context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Unhealthy

Readiness probe failed: Get "http://10.132.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

ProbeError

Readiness probe error: Get "http://10.132.0.107:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

Killing

Stopping container istio-proxy
(x17)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-ws6th

Unhealthy

Readiness probe failed: Get "https://10.132.0.63:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulDelete

Deleted pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-52d5t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulCreate

Created pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulCreate

Created pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

openshift-ingress

deployment-controller

e2e-worker-w4-4ec609-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4ec609-openshift-default-66fc5976ff from 1 to 3

openshift-ingress

gateway_labeler_controller

e2e-api-a-8d3b6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-8d3b6f

openshift-ingress

multus

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

Created

Container created

openshift-ingress

multus

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-api-a-8d3b6f-openshift-default-75785f64b7

SuccessfulCreate

Created pod: e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

openshift-ingress

deployment-controller

e2e-api-a-8d3b6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-8d3b6f-openshift-default-75785f64b7 from 0 to 1

openshift-ingress

multus

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-8d3b6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8d3b6f: serviceaccount "payload-processing-e2e-api-a-8d3b6f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8d3b6f: serviceaccount "payload-processing-e2e-api-a-8d3b6f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-8d3b6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8d3b6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8d3b6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-a-cf283d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-cf283d-openshift-default-7c6cfc484f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-cf283d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-cf283d

openshift-ingress

replicaset-controller

e2e-api-a-cf283d-openshift-default-7c6cfc484f

SuccessfulCreate

Created pod: e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

openshift-ingress

multus

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-cf283d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-cf283d-884ff6cc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cf283d-884ff6cc8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-cf283d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-cf283d-b99794875 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cf283d-b99794875

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-cf283d-b99794875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cf283d: serviceaccount "payload-processing-e2e-api-a-cf283d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-cf283d-b99794875

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-cf283d-884ff6cc8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-cf283d-884ff6cc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-cf283d: serviceaccount "payload-processing-e2e-api-a-cf283d" not found

openshift-ingress

multus

payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-mt-111f9c64

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-111f9c64

openshift-ingress

replicaset-controller

e2e-mt-111f9c64-openshift-default-69ffbd44fc

SuccessfulCreate

Created pod: e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

openshift-ingress

deployment-controller

e2e-mt-111f9c64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-111f9c64-openshift-default-69ffbd44fc from 0 to 1

openshift-ingress

multus

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-111f9c64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-111f9c64-7676b8f96c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-111f9c64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-111f9c64-759998544b from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-111f9c64-759998544b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-111f9c64-759998544b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-111f9c64: serviceaccount "payload-processing-e2e-mt-111f9c64" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-111f9c64: serviceaccount "payload-processing-e2e-mt-111f9c64" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-111f9c64-759998544b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

ProbeError

Startup probe error: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

Unhealthy

Startup probe failed: Get "http://10.132.0.132:15021/healthz/ready": dial tcp 10.132.0.132:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-4477e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4477e2-openshift-default-57d45d7cc7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4477e2-openshift-default-57d45d7cc7

SuccessfulCreate

Created pod: e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

openshift-ingress

gateway_labeler_controller

e2e-api-b-4477e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4477e2

openshift-ingress

multus

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

Unhealthy

Readiness probe failed: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

Unhealthy

Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

ProbeError

Readiness probe error: Get "http://10.133.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

Unhealthy

Readiness probe failed: Get "http://10.132.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

ProbeError

Readiness probe error: Get "http://10.132.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

ProbeError

Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

Unhealthy

Readiness probe failed: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-api-a-61d11a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-61d11a
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

ProbeError

Readiness probe error: Get "http://10.132.0.97:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-api-a-61d11a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-61d11a-openshift-default-cdfc559c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-61d11a-openshift-default-cdfc559c7

SuccessfulCreate

Created pod: e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

openshift-ingress

multus

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-4ec609-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4ec609-openshift-default-66fc5976ff from 3 to 4

openshift-ingress

multus

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulCreate

Created pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8d3b6f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4477e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4477e2-995c7ff66 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8d3b6f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4477e2: serviceaccount "payload-processing-e2e-api-b-4477e2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4477e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4477e2-995c7ff66

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4477e2-995c7ff66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4477e2: serviceaccount "payload-processing-e2e-api-b-4477e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4477e2-995c7ff66

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

Unhealthy

Startup probe failed: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

ProbeError

Startup probe error: Get "http://10.132.0.141:15021/healthz/ready": dial tcp 10.132.0.141:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-61d11a-7759448859

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-61d11a-7759448859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-61d11a: serviceaccount "payload-processing-e2e-api-a-61d11a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-61d11a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-61d11a-7cbbf5dd98 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-61d11a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-61d11a-7759448859 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-61d11a-7cbbf5dd98

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-61d11a-7cbbf5dd98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-61d11a: serviceaccount "payload-processing-e2e-api-a-61d11a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-61d11a-7759448859

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-61d11a-7cbbf5dd98

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf

openshift-ingress

multus

payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

ProbeError

Readiness probe error: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-mcbsf

Unhealthy

Readiness probe failed: Get "http://10.132.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-mj77z

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-mj77z

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mj77z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-61d11a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-61d11a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mj77z

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mj77z

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mj77z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.122s (4.122s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mj77z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mj77z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-cf283d-openshift-default-7c6cfc484f

SuccessfulCreate

Created pod: e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

openshift-ingress

replicaset-controller

e2e-api-a-cf283d-openshift-default-7c6cfc484f

SuccessfulCreate

Created pod: e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

openshift-ingress

replicaset-controller

e2e-api-a-cf283d-openshift-default-7c6cfc484f

SuccessfulCreate

Created pod: e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cf283d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-api-a-cf283d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-cf283d-openshift-default-7c6cfc484f from 1 to 4

openshift-ingress

multus

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

Created

Container created

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

Started

Container started

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

Started

Container started

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

Created

Container created

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

Created

Container created

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

Started

Container started

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-b-4b1a4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4b1a4c-openshift-default-758c6df5d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4b1a4c-openshift-default-758c6df5d5

SuccessfulCreate

Created pod: e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

openshift-ingress

gateway_labeler_controller

e2e-api-b-4b1a4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4b1a4c

openshift-ingress

multus

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-a-69932e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-69932e-openshift-default-6f5f5545b9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-69932e-openshift-default-6f5f5545b9

SuccessfulCreate

Created pod: e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c
(x6)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-69932e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-69932e
(x2)

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

multus

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4b1a4c-86b788bb5d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4b1a4c-86b788bb5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4b1a4c: serviceaccount "payload-processing-e2e-api-b-4b1a4c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4b1a4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4b1a4c-86b788bb5d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4b1a4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4b1a4c: serviceaccount "payload-processing-e2e-api-b-4b1a4c" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-111f9c64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-111f9c64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4b1a4c-86b788bb5d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

openshift-ingress

kubelet

payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

Unhealthy

Startup probe failed: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

ProbeError

Startup probe error: Get "http://10.132.0.137:15021/healthz/ready": dial tcp 10.132.0.137:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

ProbeError

Startup probe error: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

Unhealthy

Startup probe failed: Get "http://10.132.0.133:15021/healthz/ready": dial tcp 10.132.0.133:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cf283d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cf283d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-69932e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-69932e-774bbd5475 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-69932e-774bbd5475

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-69932e-774bbd5475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-69932e: serviceaccount "payload-processing-e2e-api-a-69932e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-69932e-6d756dcf5d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-69932e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-69932e-6d756dcf5d from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-69932e-6d756dcf5d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-69932e-6d756dcf5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-69932e: serviceaccount "payload-processing-e2e-api-a-69932e" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-69932e-774bbd5475

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cf283d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-cf283d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulDelete

Deleted pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-8gptp

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-111f9c64-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-111f9c64-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-61d11a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-61d11a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

Unhealthy

Readiness probe failed: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

ProbeError

Readiness probe error: Get "http://10.132.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-e67696

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e67696

openshift-ingress

multus

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-e67696-openshift-default-77f68fc745

SuccessfulCreate

Created pod: e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

openshift-ingress

deployment-controller

e2e-api-b-e67696-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e67696-openshift-default-77f68fc745 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4477e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4477e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e67696-8f8b6cbd6

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e67696-8f8b6cbd6

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e67696-8f8b6cbd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e67696: serviceaccount "payload-processing-e2e-api-b-e67696" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e67696

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e67696

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e67696-8f8b6cbd6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e67696: serviceaccount "payload-processing-e2e-api-b-e67696" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4477e2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4477e2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4b1a4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4b1a4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69932e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69932e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 10 to 5

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-sq8th

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-9bzhl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-rvnp2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-khwpn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-jmhj4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4b1a4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-4b1a4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69932e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-69932e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-api-a-cf283d-884ff6cc8-5bmms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-cf283d-b99794875-llrmk

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 10 to 5

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-api-b-585635-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-585635-openshift-default-5b9fc8b859 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-c422j

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-585635

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-585635

openshift-ingress

replicaset-controller

e2e-api-b-585635-openshift-default-5b9fc8b859

SuccessfulCreate

Created pod: e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

openshift-ingress

multus

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

AddedInterface

Add eth0 [10.132.0.146/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-7nrhd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 10 to 7

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-zfs66

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-7vc7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-6mn87

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-p4m6s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-qq7md

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

ProbeError

Readiness probe error: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

Unhealthy

Readiness probe failed: Get "http://10.132.0.144:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-wh4vb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-585635

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-585635-5598c7d4d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-585635-5598c7d4d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-585635-5598c7d4d-f4982

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-585635-5dffcfd79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-585635

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-585635-5dffcfd79 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-585635-5598c7d4d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-585635-5598c7d4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-585635: serviceaccount "payload-processing-e2e-api-b-585635" not found
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-585635-5dffcfd79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-585635-5dffcfd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-585635: serviceaccount "payload-processing-e2e-api-b-585635" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-585635-5598c7d4d-f4982

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-585635-5598c7d4d-f4982

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-585635-5598c7d4d-f4982

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-585635-5598c7d4d-f4982

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

Started

Container started

opendatahub

kubelet

test-curl-7337-1062c2

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

multus

test-curl-7337-1062c2

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7337-1062c2

Started

Container started

opendatahub

kubelet

test-curl-7337-1062c2

Created

Container created

opendatahub

kubelet

test-curl-7337-1062c2

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.197s (2.197s including waiting). Image size: 106100986 bytes.
(x5)

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused

opendatahub

kubelet

test-curl-7337-1062c2

Killing

Stopping container test-curl-7337-1062c2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 7 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e67696-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e67696-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-8d3b6f-openshift-default-75785f64b7-c5mrt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-n4dkv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4477e2-55fc4bcff9-4x6qk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4477e2-995c7ff66-8w9p8

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e67696-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-e67696-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d11a-7759448859-vzndl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulDelete

Deleted pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-rz6cp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-4ec609-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-4ec609-openshift-default-66fc5976ff from 4 to 3

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-fflqq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-cf283d-openshift-default-7c6cfc484f-jv2ft

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-4ec609-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-4ec609-openshift-default-66fc5976ff from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulDelete

Deleted pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

ProbeError

Readiness probe error: Get "http://10.132.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Unhealthy

Readiness probe failed: Get "http://10.132.0.146:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

ProbeError

Startup probe error: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Unhealthy

Startup probe failed: Get "http://10.132.0.146:15021/healthz/ready": dial tcp 10.132.0.146:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.86:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-585635-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-585635-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-tzs66

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-tzs66

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 9 to 6

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-5mm4g

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-4vfdh

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-lvnj7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-5mm4g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-4vfdh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lvnj7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-a-69932e-6d756dcf5d-c8w5p

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-585635-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-585635-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-69932e-774bbd5475-gvztq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-4477e2-openshift-default-57d45d7cc7-hhtdq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-111f9c64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-111f9c64-7676b8f96c from 0 to 1

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-111f9c64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-111f9c64-759998544b from 0 to 1

openshift-ingress

kubelet

e2e-api-a-61d11a-openshift-default-cdfc559c7-k2bs7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-111f9c64: serviceaccount "payload-processing-e2e-mt-111f9c64" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-111f9c64-759998544b

SuccessfulCreate

Created pod: payload-processing-e2e-mt-111f9c64-759998544b-zkrvk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-111f9c64-759998544b

FailedCreate

Error creating: pods "payload-processing-e2e-mt-111f9c64-759998544b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-111f9c64: serviceaccount "payload-processing-e2e-mt-111f9c64" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54

openshift-ingress

multus

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-111f9c64-759998544b-zkrvk

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-zkrvk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-zkrvk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-zkrvk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e67696-66c9b6dfdc-g5mtr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e67696-8f8b6cbd6-nxb2b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulDelete

Deleted pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 5 to 3

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 5 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5jlm9

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 5 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-rmnvr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-rmnvr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-ipp-a-d80c7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d80c7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d80c7d

openshift-ingress

replicaset-controller

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5

SuccessfulCreate

Created pod: e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

openshift-ingress

multus

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a299b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a299b8

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-p82xp

openshift-ingress

multus

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-a299b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a299b8-openshift-default-59d66db8cc from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-ipp-a-a299b8-openshift-default-59d66db8cc

SuccessfulCreate

Created pod: e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 5 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-p82xp

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-p82xp

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-p82xp

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-p82xp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d80c7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d80c7d-798dbf97cb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d80c7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d80c7d: serviceaccount "payload-processing-e2e-ipp-a-d80c7d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d80c7d: serviceaccount "payload-processing-e2e-ipp-a-d80c7d" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6

Created

Container created
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-p82xp

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-p82xp

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a299b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a299b8-69d9ff7846 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a299b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a299b8-69d9ff7846

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a299b8-69d9ff7846

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a299b8-69d9ff7846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a299b8: serviceaccount "payload-processing-e2e-ipp-a-a299b8" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a299b8: serviceaccount "payload-processing-e2e-ipp-a-a299b8" not found

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-fpsfd

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-694db55c87 from 6 to 10

openshift-ingress

kubelet

e2e-api-a-69932e-openshift-default-6f5f5545b9-zcp9c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-zqnbt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-8shs8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-694db55c87-lfxgm

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-zqnbt

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-zqnbt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fpsfd

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-lfxgm

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8shs8

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8shs8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-fpsfd

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fpsfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-694db55c87-8shs8

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-zqnbt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8shs8

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fpsfd

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-zqnbt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fpsfd

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fpsfd

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-585635-5598c7d4d-f4982

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-585635-5dffcfd79-d2dg5

Killing

Stopping container payload-pre-processing
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-zqnbt

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8shs8

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8shs8

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-zqnbt

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d80c7d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d80c7d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-z52kj

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-44n5f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

multus

test-curl-7337-a890cc

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7337-a890cc

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7337-a890cc

Started

Container started

opendatahub

kubelet

test-curl-7337-a890cc

Created

Container created

opendatahub

kubelet

test-curl-7337-a890cc

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.984s (2.984s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7337-a890cc

Killing

Stopping container test-curl-7337-a890cc

openshift-ingress

kubelet

e2e-api-b-e67696-openshift-default-77f68fc745-fvgqg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ffe14b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ffe14b

openshift-ingress

replicaset-controller

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7

SuccessfulCreate

Created pod: e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

openshift-ingress

multus

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-ffe14b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ffe14b-openshift-default-848dcb67b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-111f9c64-759998544b-zkrvk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-bts54

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ffe14b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ffe14b-76d78847cb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ffe14b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ffe14b: serviceaccount "payload-processing-e2e-ipp-a-ffe14b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ffe14b-76d78847cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ffe14b-76d78847cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ffe14b: serviceaccount "payload-processing-e2e-ipp-a-ffe14b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ffe14b-76d78847cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

ProbeError

Readiness probe error: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

Unhealthy

Readiness probe failed: Get "http://10.134.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d80c7d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-d80c7d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8b0edc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8b0edc

openshift-ingress

replicaset-controller

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7

SuccessfulCreate

Created pod: e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

openshift-ingress

deployment-controller

e2e-ipp-b-8b0edc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a299b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a299b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8b0edc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8b0edc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8b0edc-598876d6c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-3f9b9b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3f9b9b

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b0edc-598876d6c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b0edc-598876d6c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8b0edc-598876d6c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b0edc: serviceaccount "payload-processing-e2e-ipp-b-8b0edc" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b0edc: serviceaccount "payload-processing-e2e-ipp-b-8b0edc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl

openshift-ingress

multus

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-b-3f9b9b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-3f9b9b-openshift-default-579df67bd7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7

SuccessfulCreate

Created pod: e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

openshift-ingress

multus

payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl

Created

Container created

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-eaa6d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-eaa6d2

openshift-ingress

deployment-controller

e2e-ipp-a-eaa6d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5

SuccessfulCreate

Created pod: e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b: serviceaccount "payload-processing-e2e-ipp-b-3f9b9b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3f9b9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g

openshift-ingress

multus

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b: serviceaccount "payload-processing-e2e-ipp-b-3f9b9b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3f9b9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9

AddedInterface

Add eth0 [10.132.0.172/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g

Created

Container created

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-111f9c64-openshift-default-69ffbd44fc-fnfzf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5

SuccessfulCreate

Created pod: e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

openshift-ingress

deployment-controller

e2e-ipp-a-2d2ca9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5 from 0 to 1

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-2d2ca9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-2d2ca9

openshift-ingress

kubelet

e2e-api-b-585635-openshift-default-5b9fc8b859-29hbx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

Created

Container created

openshift-ingress

multus

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-eaa6d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-eaa6d2-b98b565c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-eaa6d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2: serviceaccount "payload-processing-e2e-ipp-a-eaa6d2" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2: serviceaccount "payload-processing-e2e-ipp-a-eaa6d2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a299b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a299b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2d2ca9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2d2ca9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2d2ca9: serviceaccount "payload-processing-e2e-ipp-a-2d2ca9" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2d2ca9: serviceaccount "payload-processing-e2e-ipp-a-2d2ca9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc

openshift-ingress

multus

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d80c7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d80c7d: serviceaccount "payload-processing-e2e-ipp-a-d80c7d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d80c7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d80c7d: serviceaccount "payload-processing-e2e-ipp-a-d80c7d" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

openshift-ingress

multus

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.581s (2.581s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ffe14b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ffe14b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.003s (2.003s including waiting). Image size: 166612641 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a299b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a299b8-58bd89c49b from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a299b8: serviceaccount "payload-processing-e2e-ipp-a-a299b8" not found

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-77a92c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-77a92c
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a299b8-58bd89c49b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a299b8-58bd89c49b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a299b8: serviceaccount "payload-processing-e2e-ipp-a-a299b8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a299b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-77a92c-openshift-default-68f8fb874c

SuccessfulCreate

Created pod: e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

openshift-ingress

deployment-controller

e2e-ipp-b-77a92c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-77a92c-openshift-default-68f8fb874c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-76d78847cb-gq7tv

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr

AddedInterface

Add eth0 [10.132.0.179/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a299b8-58bd89c49b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ffe14b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-ffe14b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-77a92c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-77a92c-64d9fc577b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77a92c-64d9fc577b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-77a92c-64d9fc577b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77a92c: serviceaccount "payload-processing-e2e-ipp-b-77a92c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77a92c-64d9fc577b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77a92c: serviceaccount "payload-processing-e2e-ipp-b-77a92c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-77a92c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77a92c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77a92c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b0edc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b0edc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

ProbeError

Readiness probe error: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

Unhealthy

Readiness probe failed: Get "http://10.134.0.103:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

Unhealthy

Startup probe failed: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

ProbeError

Startup probe error: Get "http://10.134.0.103:15021/healthz/ready": dial tcp 10.134.0.103:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b0edc-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8b0edc-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ffe14b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ffe14b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ffe14b-7b5976df9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ffe14b: serviceaccount "payload-processing-e2e-ipp-a-ffe14b" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eaa6d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eaa6d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ffe14b: serviceaccount "payload-processing-e2e-ipp-a-ffe14b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.387s (2.387s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.441s (1.441s including waiting). Image size: 166612641 bytes.
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3f9b9b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2d2ca9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-3f9b9b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2d2ca9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eaa6d2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-eaa6d2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-7657f5c9b8-pg9z9

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-66ccc5955-mk88g

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-bwqd9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

Unhealthy

Startup probe failed: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

ProbeError

Startup probe error: Get "http://10.134.0.104:15021/healthz/ready": dial tcp 10.134.0.104:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-c60685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c60685-openshift-default-68f76c87c from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c60685-openshift-default-68f76c87c

SuccessfulCreate

Created pod: e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c60685

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c60685

openshift-ingress

multus

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-6779c84bc9-g5wns

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-b98b565c4-t4zwp

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2d2ca9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-2d2ca9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c60685: serviceaccount "payload-processing-e2e-ipp-b-c60685" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c60685

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c60685-5d446879b7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c60685-69dcf9c86b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c60685-69dcf9c86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c60685: serviceaccount "payload-processing-e2e-ipp-b-c60685" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c60685-69dcf9c86b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c60685

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c60685-69dcf9c86b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw

openshift-ingress

multus

payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f700fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f700fe

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-56b6c7589f-vpjcz

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77

SuccessfulCreate

Created pod: e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

openshift-ingress

deployment-controller

e2e-ipp-b-f700fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f700fe-openshift-default-6bbbbddb77 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-56b4bf6c58-s7sqc

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77a92c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-77a92c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f700fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f700fe-56cffff755 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f700fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f700fe-7bcf4b647d from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f700fe: serviceaccount "payload-processing-e2e-ipp-b-f700fe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f700fe: serviceaccount "payload-processing-e2e-ipp-b-f700fe" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-65f6f789f-rxgqj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-64d9fc577b-pbdb5

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f700fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f700fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8b0edc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8b0edc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b0edc: serviceaccount "payload-processing-e2e-ipp-b-8b0edc" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8b0edc: serviceaccount "payload-processing-e2e-ipp-b-8b0edc" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr

AddedInterface

Add eth0 [10.134.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 10 to 7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-8shs8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-859kr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8shs8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-zqnbt

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-zqnbt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-859kr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-bvpp2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-3f9b9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-3f9b9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b: serviceaccount "payload-processing-e2e-ipp-b-3f9b9b" not found
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b: serviceaccount "payload-processing-e2e-ipp-b-3f9b9b" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-eaa6d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-eaa6d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2: serviceaccount "payload-processing-e2e-ipp-a-eaa6d2" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2: serviceaccount "payload-processing-e2e-ipp-a-eaa6d2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2d2ca9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2d2ca9-6f4698d568 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2d2ca9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2d2ca9: serviceaccount "payload-processing-e2e-ipp-a-2d2ca9" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2d2ca9: serviceaccount "payload-processing-e2e-ipp-a-2d2ca9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

AddedInterface

Add eth0 [10.133.0.105/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.713s (2.713s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d80c7d-7ccb889d7-2rkfh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d80c7d-64bd4b8c8-l7h8s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a299b8-58bd89c49b-87wrs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a299b8-7b9767b959-dp9hr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Unhealthy

Readiness probe failed: Get "http://10.133.0.98:15021/healthz/ready": read tcp 10.133.0.2:43672->10.133.0.98:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

ProbeError

Readiness probe error: Get "http://10.133.0.98:15021/healthz/ready": read tcp 10.133.0.2:43672->10.133.0.98:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-77a92c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-77a92c-8b4fdbc54 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-77a92c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-77a92c-b99f9447 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77a92c: serviceaccount "payload-processing-e2e-ipp-b-77a92c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr
(x10)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-77a92c: serviceaccount "payload-processing-e2e-ipp-b-77a92c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-ffe14b-openshift-default-848dcb67b7-j7bs6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Unhealthy

Startup probe failed: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

ProbeError

Startup probe error: Get "http://10.133.0.98:15021/healthz/ready": dial tcp 10.133.0.98:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c60685-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c60685-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c60685-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-c60685-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f61bae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f61bae

openshift-ingress

replicaset-controller

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c

SuccessfulCreate

Created pod: e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

openshift-ingress

deployment-controller

e2e-praxis-a-f61bae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c from 0 to 1

openshift-ingress

multus

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-mj77z

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-mj77z

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f61bae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f61bae-86bcc7b558 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f61bae-86bcc7b558

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f61bae-86bcc7b558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f61bae: serviceaccount "payload-processing-e2e-praxis-a-f61bae" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f61bae-86bcc7b558

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f61bae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f61bae-795969f54c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f61bae: serviceaccount "payload-processing-e2e-praxis-a-f61bae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2

AddedInterface

Add eth0 [10.132.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-fpsfd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 7 to 5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-p82xp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-p82xp
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-5d446879b7-d72xw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8b0edc-6db5488f59-8fjxs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-84ad63

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-84ad63

openshift-ingress

kubelet

e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-8b0edc-openshift-default-7ccf7c4f7-bl5zr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-84ad63-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-84ad63-openshift-default-69f4b8cf49 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49

SuccessfulCreate

Created pod: e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-389c4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-389c4e

openshift-ingress

replicaset-controller

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f

SuccessfulCreate

Created pod: e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

openshift-ingress

deployment-controller

e2e-praxis-a-389c4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f from 0 to 1

openshift-ingress

multus

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

Unhealthy

Startup probe failed: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

ProbeError

Startup probe error: Get "http://10.134.0.108:15021/healthz/ready": dial tcp 10.134.0.108:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-84ad63

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-84ad63: serviceaccount "payload-processing-e2e-praxis-a-84ad63" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-84ad63

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-84ad63: serviceaccount "payload-processing-e2e-praxis-a-84ad63" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h

AddedInterface

Add eth0 [10.132.0.194/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-389c4e: serviceaccount "payload-processing-e2e-praxis-a-389c4e" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-389c4e-79f9d89976

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-389c4e-79f9d89976-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-389c4e: serviceaccount "payload-processing-e2e-praxis-a-389c4e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-389c4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-389c4e-79f9d89976 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-389c4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-389c4e-856bd97979 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-389c4e-79f9d89976

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-84ad63-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-84ad63-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-389c4e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-389c4e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c60685

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c60685-84694f8d48 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c60685

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c60685-84694f8d48

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c60685-84694f8d48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c60685: serviceaccount "payload-processing-e2e-ipp-b-c60685" not found
(x8)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c60685: serviceaccount "payload-processing-e2e-ipp-b-c60685" not found
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f700fe-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c60685-84694f8d48

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-f700fe-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2d2ca9-6f4698d568-lhlsj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2d2ca9-76879b9f9-97sgs

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-2d2ca9-openshift-default-7c5b8f9cd5-j45d9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

ProbeError

Startup probe error: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

Unhealthy

Startup probe failed: Get "http://10.134.0.118:15021/healthz/ready": dial tcp 10.134.0.118:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f61bae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f61bae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f700fe-56cffff755-ck8pz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f61bae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f61bae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-praxis-b-115a78-openshift-default-664b49d565

SuccessfulCreate

Created pod: e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-115a78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-115a78

openshift-ingress

deployment-controller

e2e-praxis-b-115a78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-115a78-openshift-default-664b49d565 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-115a78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-115a78-76c6f6c696 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-115a78: serviceaccount "payload-processing-e2e-praxis-b-115a78" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-115a78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-115a78-76c6f6c696

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-115a78-76c6f6c696

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-115a78-76c6f6c696-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-115a78: serviceaccount "payload-processing-e2e-praxis-b-115a78" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn

Created

Container created

openshift-ingress

multus

payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-84ad63-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-84ad63-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-a-e6b14d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-e6b14d-openshift-default-6c66666b69 from 0 to 1

openshift-ingress

deployment-controller

e2e-praxis-a-389c4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f from 1 to 4

openshift-ingress

replicaset-controller

e2e-praxis-a-e6b14d-openshift-default-6c66666b69

SuccessfulCreate

Created pod: e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn
(x2)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-389c4e-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f

SuccessfulCreate

Created pod: e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

openshift-ingress

replicaset-controller

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f

SuccessfulCreate

Created pod: e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-e6b14d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-e6b14d

openshift-ingress

replicaset-controller

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f

SuccessfulCreate

Created pod: e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd
(x2)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

Started

Container started

openshift-ingress

multus

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

multus

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

Created

Container created

openshift-ingress

multus

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

Unhealthy

Readiness probe failed: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56

ProbeError

Readiness probe error: Get "http://10.134.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

ProbeError

Startup probe error: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

Unhealthy

Startup probe failed: Get "http://10.132.0.192:15021/healthz/ready": dial tcp 10.132.0.192:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-e6b14d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-e6b14d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-e6b14d-d77c786b8 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e6b14d-d77c786b8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-e6b14d-d77c786b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e6b14d: serviceaccount "payload-processing-e2e-praxis-a-e6b14d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-e6b14d-d77c786b8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-e6b14d: serviceaccount "payload-processing-e2e-praxis-a-e6b14d" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 5 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-a3c171

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-a3c171

openshift-ingress

deployment-controller

e2e-praxis-b-a3c171-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-a3c171-openshift-default-5b5d48b545 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-a3c171-openshift-default-5b5d48b545

SuccessfulCreate

Created pod: e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-lfxgm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f53eb9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f53eb9

openshift-ingress

replicaset-controller

e2e-praxis-b-f53eb9-openshift-default-6fb6597977

SuccessfulCreate

Created pod: e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

openshift-ingress

deployment-controller

e2e-praxis-b-f53eb9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f53eb9-openshift-default-6fb6597977 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-a3c171

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-a3c171-66975dc446 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-a3c171

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a3c171: serviceaccount "payload-processing-e2e-praxis-b-a3c171" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a3c171-66975dc446

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-a3c171-66975dc446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a3c171: serviceaccount "payload-processing-e2e-praxis-b-a3c171" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a3c171-66975dc446

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-389c4e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-389c4e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f53eb9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f53eb9-5c675c76bb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f53eb9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f53eb9: serviceaccount "payload-processing-e2e-praxis-b-f53eb9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f53eb9: serviceaccount "payload-processing-e2e-praxis-b-f53eb9" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj

AddedInterface

Add eth0 [10.132.0.208/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x

AddedInterface

Add eth0 [10.132.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a3c171-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a3c171-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

ProbeError

Startup probe error: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

Unhealthy

Startup probe failed: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-115a78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-115a78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-115a78-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-115a78-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-4ec609-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

Unhealthy

Startup probe failed: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-4ec609-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-4ec609-openshift-default-66fc5976ff from 2 to 1
(x5)

openshift-ingress

kubelet

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

ProbeError

Startup probe error: Get "http://10.134.0.123:15021/healthz/ready": dial tcp 10.134.0.123:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-4ec609-openshift-default-66fc5976ff

SuccessfulDelete

Deleted pod: e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-b0a183-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-b0a183-openshift-default-657d79bfdc

SuccessfulDelete

Deleted pod: e2e-worker-w2-b0a183-openshift-default-657d79bfdc-q76ml

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-m6b9x

openshift-ingress

deployment-controller

e2e-worker-w2-b0a183-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-b0a183-openshift-default-657d79bfdc from 2 to 1

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 4 to 3

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-8nrtp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-k7lgc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-9q89z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e6b14d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-e6b14d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

Unhealthy

Startup probe failed: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

ProbeError

Startup probe error: Get "http://10.133.0.110:15021/healthz/ready": dial tcp 10.133.0.110:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f53eb9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f53eb9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f61bae-795969f54c-zrwc2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f61bae-86bcc7b558-4khb6

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a3c171-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a3c171-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f53eb9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f53eb9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-04679c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-04679c

openshift-ingress

multus

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf

SuccessfulCreate

Created pod: e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

openshift-ingress

deployment-controller

e2e-praxis-b-04679c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-04679c-openshift-default-7b7b8b77bf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-04679c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-04679c-86c54d7f84 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-04679c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-04679c-86c54d7f84

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-04679c-86c54d7f84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-04679c: serviceaccount "payload-processing-e2e-praxis-b-04679c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-04679c: serviceaccount "payload-processing-e2e-praxis-b-04679c" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-04679c-86c54d7f84

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-84ad63-5ddbb7cfd8-b7b2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-84ad63-bc4fcf5dc-c9qzr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

(combined from similar events): Deleted pod: maas-default-gateway-openshift-default-694db55c87-6ns9w

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-6ns9w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-115a78-76c6f6c696-n2789

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-115a78-5899dfdc79-4mzzn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-84ad63-openshift-default-69f4b8cf49-2q95h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a3c171-789cccdb7-hv9gf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a3c171-66975dc446-jbl25

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

ProbeError

Startup probe error: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

Unhealthy

Startup probe failed: Get "http://10.133.0.113:15021/healthz/ready": dial tcp 10.133.0.113:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-04679c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-04679c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp

Unhealthy

Readiness probe failed: dial tcp 10.134.0.120:9004: i/o timeout

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-e6b14d-768b64465f-8w6xn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-e6b14d-d77c786b8-7pwvr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-praxis-a-d5d3ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-d5d3ba-openshift-default-66c66f9745 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745

SuccessfulCreate

Created pod: e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

openshift-ingress

multus

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-d5d3ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-d5d3ba

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 1 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-c60685-openshift-default-68f76c87c-b2w7h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

Unhealthy

Startup probe failed: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

ProbeError

Startup probe error: Get "http://10.134.0.127:15021/healthz/ready": dial tcp 10.134.0.127:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-d5d3ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-d5d3ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d5d3ba: serviceaccount "payload-processing-e2e-praxis-a-d5d3ba" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp

AddedInterface

Add eth0 [10.132.0.215/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-d5d3ba: serviceaccount "payload-processing-e2e-praxis-a-d5d3ba" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-389c4e-79f9d89976-m948g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-389c4e-856bd97979-gdrrb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-04679c-86c54d7f84-prhpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-04679c-696cc7bfd7-zdpv7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

AddedInterface

Add eth0 [10.132.0.218/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

Unhealthy

Startup probe failed: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

ProbeError

Startup probe error: Get "http://10.132.0.218:15021/healthz/ready": dial tcp 10.132.0.218:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-04679c-openshift-default-7b7b8b77bf-thkf5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

Unhealthy

Startup probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

ProbeError

Startup probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d5d3ba-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d5d3ba-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

ProbeError

Startup probe error: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

Unhealthy

Startup probe failed: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-0b9215

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-0b9215

openshift-ingress

replicaset-controller

e2e-praxis-b-0b9215-openshift-default-794f8d99c7

SuccessfulCreate

Created pod: e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

openshift-ingress

deployment-controller

e2e-praxis-b-0b9215-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-0b9215-openshift-default-794f8d99c7 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-0b9215-6f85b674d8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-0b9215-6f85b674d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-0b9215: serviceaccount "payload-processing-e2e-praxis-b-0b9215" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-0b9215: serviceaccount "payload-processing-e2e-praxis-b-0b9215" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-0b9215

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-0b9215-6f85b674d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-0b9215

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-0b9215-6f85b674d8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d5d3ba-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-d5d3ba-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-rnkwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-tkb49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-wghdd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w0-547082-openshift-default-c85f94499

SuccessfulCreate

Created pod: e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-547082

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-547082

openshift-ingress

deployment-controller

e2e-shared-a-w0-547082-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-547082-openshift-default-c85f94499 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f53eb9-597ccf9699-jz6pj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f53eb9-5c675c76bb-xks4x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-547082

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-547082-74fc5b6748 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-547082: serviceaccount "payload-processing-e2e-shared-a-w0-547082" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-547082-74fc5b6748

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-547082-74fc5b6748-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-547082: serviceaccount "payload-processing-e2e-shared-a-w0-547082" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-547082

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-547082-74fc5b6748

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

AddedInterface

Add eth0 [10.132.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

AddedInterface

Add eth0 [10.133.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

Created

Container created

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

AddedInterface

Add eth0 [10.132.0.239/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-487c5f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-487c5f

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-cafbb2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-cafbb2

openshift-ingress

replicaset-controller

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c

SuccessfulCreate

Created pod: e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

openshift-ingress

deployment-controller

e2e-shared-a-w1-cafbb2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc

SuccessfulCreate

Created pod: e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

openshift-ingress

deployment-controller

e2e-shared-a-w3-487c5f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-487c5f-openshift-default-d66698ddc from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

Unhealthy

Startup probe failed: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

ProbeError

Startup probe error: Get "http://10.132.0.239:15021/healthz/ready": dial tcp 10.132.0.239:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

ProbeError

Startup probe error: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

Unhealthy

Startup probe failed: Get "http://10.133.0.145:15021/healthz/ready": dial tcp 10.133.0.145:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-f53eb9-openshift-default-6fb6597977-76thp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-056a27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-056a27

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 4 to 6

openshift-ingress

replicaset-controller

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f

SuccessfulCreate

Created pod: e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

openshift-ingress

deployment-controller

e2e-shared-a-w2-056a27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-056a27-openshift-default-79ff5c986f from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulCreate

Created pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-487c5f-7875df5768

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

AddedInterface

Add eth0 [10.133.0.146/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

AddedInterface

Add eth0 [10.132.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-487c5f-7875df5768

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-487c5f-7875df5768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-487c5f: serviceaccount "payload-processing-e2e-shared-a-w3-487c5f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-487c5f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-487c5f-7875df5768 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-487c5f: serviceaccount "payload-processing-e2e-shared-a-w3-487c5f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-487c5f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc from 0 to 1

openshift-ingress

multus

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

AddedInterface

Add eth0 [10.133.0.147/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

AddedInterface

Add eth0 [10.132.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

AddedInterface

Add eth0 [10.132.0.242/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

AddedInterface

Add eth0 [10.132.0.243/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-cafbb2: serviceaccount "payload-processing-e2e-shared-a-w1-cafbb2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-cafbb2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-cafbb2-68549d456b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-cafbb2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-cafbb2: serviceaccount "payload-processing-e2e-shared-a-w1-cafbb2" not found

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5

AddedInterface

Add eth0 [10.132.0.244/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh

AddedInterface

Add eth0 [10.132.0.245/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-056a27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-056a27-597b5d9878 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

Unhealthy

Startup probe failed: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

Unhealthy

Startup probe failed: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

ProbeError

Startup probe error: Get "http://10.132.0.240:15021/healthz/ready": dial tcp 10.132.0.240:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

ProbeError

Startup probe error: Get "http://10.133.0.147:15021/healthz/ready": dial tcp 10.133.0.147:15021: connect: connection refused body:
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-056a27-597b5d9878

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-056a27-597b5d9878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-056a27: serviceaccount "payload-processing-e2e-shared-a-w2-056a27" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-056a27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-056a27: serviceaccount "payload-processing-e2e-shared-a-w2-056a27" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-056a27-597b5d9878

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

ProbeError

Startup probe error: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

Unhealthy

Startup probe failed: Get "http://10.132.0.243:15021/healthz/ready": dial tcp 10.132.0.243:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

Created

Container created

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

AddedInterface

Add eth0 [10.133.0.149/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

Unhealthy

Startup probe failed: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

ProbeError

Startup probe error: Get "http://10.133.0.149:15021/healthz/ready": dial tcp 10.133.0.149:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulCreate

Created pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulCreate

Created pod: e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

openshift-ingress

multus

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

AddedInterface

Add eth0 [10.134.0.138/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

Unhealthy

Startup probe failed: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

ProbeError

Startup probe error: Get "http://10.134.0.138:15021/healthz/ready": dial tcp 10.134.0.138:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-0b9215-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-0b9215-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-d5d3ba-796bc7c8bb-mv6pj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-d5d3ba-6c5fc4fd59-z2fbp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-0b9215-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-0b9215-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-547082-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-547082-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

Unhealthy

Readiness probe failed: Get "http://10.134.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

ProbeError

Readiness probe error: Get "http://10.134.0.133:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Unhealthy

Readiness probe failed: Get "http://10.134.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

ProbeError

Readiness probe error: Get "http://10.134.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-e4864d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-e4864d

openshift-ingress

deployment-controller

e2e-shared-b-w0-e4864d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5

SuccessfulCreate

Created pod: e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

openshift-ingress

multus

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

AddedInterface

Add eth0 [10.134.0.139/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

ProbeError

Startup probe error: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

Unhealthy

Startup probe failed: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-e4864d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-e4864d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-487c5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-487c5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d: serviceaccount "payload-processing-e2e-shared-b-w0-e4864d" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d: serviceaccount "payload-processing-e2e-shared-b-w0-e4864d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-cafbb2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-cafbb2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

AddedInterface

Add eth0 [10.133.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-cafbb2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-cafbb2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-0b9215-6f85b674d8-qqnsh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-0b9215-6f6588f659-549t5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w3-fe49e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-fe49e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-fe49e7
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c

SuccessfulCreate

Created pod: e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

openshift-ingress

multus

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

Unhealthy

Startup probe failed: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

ProbeError

Startup probe error: Get "http://10.133.0.146:15021/healthz/ready": dial tcp 10.133.0.146:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w1-b37684-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-b37684-openshift-default-76d9679d6c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-b37684

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-b37684

openshift-ingress

replicaset-controller

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c

SuccessfulCreate

Created pod: e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

openshift-ingress

multus

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-fe49e7: serviceaccount "payload-processing-e2e-shared-b-w3-fe49e7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-487c5f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-fe49e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-487c5f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-fe49e7: serviceaccount "payload-processing-e2e-shared-b-w3-fe49e7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-fe49e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq

AddedInterface

Add eth0 [10.132.0.250/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s

AddedInterface

Add eth0 [10.132.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-b37684

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-b37684-77fcd69c56 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-b37684: serviceaccount "payload-processing-e2e-shared-b-w1-b37684" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-b37684: serviceaccount "payload-processing-e2e-shared-b-w1-b37684" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-b37684

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

AddedInterface

Add eth0 [10.132.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

AddedInterface

Add eth0 [10.132.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w2-64120b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-64120b-openshift-default-6dff766d79 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-64120b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-64120b

openshift-ingress

replicaset-controller

e2e-shared-b-w2-64120b-openshift-default-6dff766d79

SuccessfulCreate

Created pod: e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

openshift-ingress

multus

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

AddedInterface

Add eth0 [10.133.0.154/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-64120b-59d74fc496

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-64120b-59d74fc496-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-64120b: serviceaccount "payload-processing-e2e-shared-b-w2-64120b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-64120b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-64120b-59d74fc496

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-64120b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-64120b-59d74fc496 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-64120b: serviceaccount "payload-processing-e2e-shared-b-w2-64120b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

AddedInterface

Add eth0 [10.132.0.254/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

AddedInterface

Add eth0 [10.132.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-056a27-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-056a27-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-0b9215-openshift-default-794f8d99c7-bxs49

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

Unhealthy

Startup probe failed: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

ProbeError

Startup probe error: Get "http://10.134.0.139:15021/healthz/ready": dial tcp 10.134.0.139:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-explicit-4b0bf3-openshift-default-775655bcd9

SuccessfulCreate

Created pod: e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

openshift-ingress

gateway_labeler_controller

e2e-explicit-4b0bf3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-4b0bf3

openshift-ingress

deployment-controller

e2e-explicit-4b0bf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-4b0bf3-openshift-default-775655bcd9 from 0 to 1

openshift-ingress

multus

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

AddedInterface

Add eth0 [10.133.0.156/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-4b0bf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-4b0bf3-74b7b874bd from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4b0bf3-74b7b874bd

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-4b0bf3-74b7b874bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4b0bf3: serviceaccount "payload-processing-e2e-explicit-4b0bf3" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4b0bf3: serviceaccount "payload-processing-e2e-explicit-4b0bf3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-4b0bf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4b0bf3-74b7b874bd

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-fe49e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-fe49e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-e4864d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-e4864d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-fe49e7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-fe49e7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

Unhealthy

Readiness probe failed: Get "http://10.134.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

ProbeError

Readiness probe error: Get "http://10.134.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

ProbeError

Startup probe error: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

Unhealthy

Startup probe failed: Get "http://10.133.0.154:15021/healthz/ready": dial tcp 10.133.0.154:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-64120b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-64120b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-64120b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-64120b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-b37684-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-b37684-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

ProbeError

Startup probe error: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

Unhealthy

Startup probe failed: Get "http://10.133.0.156:15021/healthz/ready": dial tcp 10.133.0.156:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-4b0bf3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-4b0bf3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-4b0bf3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-4b0bf3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulDelete

Deleted pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulDelete

Deleted pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 6 to 4

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p
(x4)

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-8cj4p

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-5m89b

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

ProbeError

Readiness probe error: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s

Unhealthy

Readiness probe failed: Get "http://10.134.0.131:15021/healthz/ready": dial tcp 10.134.0.131:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulDelete

Deleted pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 4 to 3

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-b4pqb
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 3 to 2
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

Unhealthy

Readiness probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-9mvqr

ProbeError

Readiness probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-694db55c87 from 2 to 1

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-694db55c87

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-694db55c87-kr46d

openshift-ingress

kubelet

maas-default-gateway-openshift-default-694db55c87-kr46d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-n4xht

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-knf7k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulDelete

Deleted pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 3 to 2

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-jdpjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-4b0bf3-openshift-default-775655bcd9-jzptm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-bd4c7f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-bd4c7f

openshift-ingress

replicaset-controller

e2e-noten-bd4c7f-openshift-default-c966fdcb9

SuccessfulCreate

Created pod: e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7

openshift-ingress

deployment-controller

e2e-noten-bd4c7f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-bd4c7f-openshift-default-c966fdcb9 from 0 to 1

openshift-ingress

kubelet

e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7

Started

Container started

openshift-ingress

kubelet

e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7

Created

Container created

openshift-ingress

multus

e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-bd4c7f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-noten-bd4c7f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-bbfa07-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-bbfa07-openshift-default-77bf654b75 from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-bbfa07-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-bbfa07-openshift-default-77bf654b75

SuccessfulDelete

Deleted pod: e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

Killing

Stopping container istio-proxy
(x12)

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-98a19b-openshift-default-775879c667

SuccessfulDelete

Deleted pod: e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-w5pw7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-s9ccc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-a74d15-openshift-default-6659bdd657

SuccessfulDelete

Deleted pod: e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-a74d15-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-a74d15-openshift-default-6659bdd657 from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-a74d15-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

opendatahub

kubelet

test-curl-7337-952641

Started

Container started

opendatahub

multus

test-curl-7337-952641

AddedInterface

Add eth0 [10.132.1.5/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7337-952641

Created

Container created

opendatahub

kubelet

test-curl-7337-952641

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-27msn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

opendatahub

kubelet

test-curl-7337-952641

Killing

Stopping container test-curl-7337-952641

openshift-ingress

multus

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w4-742ff8-openshift-default-77b774b865

SuccessfulCreate

Created pod: e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

openshift-ingress

deployment-controller

e2e-shared-a-w4-742ff8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-742ff8-openshift-default-77b774b865 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-742ff8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-742ff8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8: serviceaccount "payload-processing-e2e-shared-a-w4-742ff8" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8: serviceaccount "payload-processing-e2e-shared-a-w4-742ff8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-742ff8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-742ff8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-742ff8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-742ff8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

multus

test-curl-7325-768ecc

AddedInterface

Add eth0 [10.132.1.7/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-768ecc

Started

Container started

opendatahub

kubelet

test-curl-7325-768ecc

Created

Container created

opendatahub

kubelet

test-curl-7325-768ecc

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7325-768ecc

Killing

Stopping container test-curl-7325-768ecc

opendatahub

kubelet

test-curl-7325-ff97ce

Created

Container created

opendatahub

kubelet

test-curl-7325-ff97ce

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7325-ff97ce

Started

Container started

opendatahub

multus

test-curl-7325-ff97ce

AddedInterface

Add eth0 [10.132.1.8/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-ff97ce

Killing

Stopping container test-curl-7325-ff97ce

opendatahub

kubelet

test-curl-7325-8cfa0c

Started

Container started

opendatahub

kubelet

test-curl-7325-8cfa0c

Created

Container created

opendatahub

multus

test-curl-7325-8cfa0c

AddedInterface

Add eth0 [10.132.1.9/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-8cfa0c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7325-3e9666

AddedInterface

Add eth0 [10.132.1.10/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7325-8cfa0c

Killing

Stopping container test-curl-7325-8cfa0c

opendatahub

kubelet

test-curl-7325-3e9666

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7325-3e9666

Started

Container started

opendatahub

kubelet

test-curl-7325-3e9666

Created

Container created

opendatahub

kubelet

test-curl-7325-3e9666

Killing

Stopping container test-curl-7325-3e9666

openshift-ingress

replicaset-controller

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c

SuccessfulCreate

Created pod: e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

openshift-ingress

deployment-controller

e2e-extmod-a-0e72bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-0e72bd-openshift-default-ff466bf5c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-0e72bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-0e72bd

openshift-ingress

multus

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

AddedInterface

Add eth0 [10.133.0.171/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

Unhealthy

Readiness probe failed: Get "http://10.133.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

ProbeError

Readiness probe error: Get "http://10.133.0.164:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-0e72bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-0e72bd-547d5b58c6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0e72bd: serviceaccount "payload-processing-e2e-extmod-a-0e72bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-0e72bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-0e72bd: serviceaccount "payload-processing-e2e-extmod-a-0e72bd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-742ff8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-742ff8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-7334-2f919b

AddedInterface

Add eth0 [10.132.1.11/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7334-2f919b

Started

Container started

opendatahub

kubelet

test-curl-7334-2f919b

Created

Container created

opendatahub

kubelet

test-curl-7334-2f919b

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7334-2f919b

Killing

Stopping container test-curl-7334-2f919b

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-9389b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-9389b9

openshift-ingress

replicaset-controller

e2e-extmod-a-9389b9-openshift-default-699f5c4f69

SuccessfulCreate

Created pod: e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

openshift-ingress

multus

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-9389b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-9389b9-openshift-default-699f5c4f69 from 0 to 1

opendatahub

kubelet

test-curl-7331-9798b1

Started

Container started

opendatahub

kubelet

test-curl-7331-9798b1

Created

Container created

opendatahub

kubelet

test-curl-7331-9798b1

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7331-9798b1

AddedInterface

Add eth0 [10.132.1.12/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7331-9798b1

Killing

Stopping container test-curl-7331-9798b1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-9389b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-9389b9-589ddf7656 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9389b9-589ddf7656

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-9389b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9389b9: serviceaccount "payload-processing-e2e-extmod-a-9389b9" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9389b9-589ddf7656

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-9389b9-589ddf7656-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9389b9: serviceaccount "payload-processing-e2e-extmod-a-9389b9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682

AddedInterface

Add eth0 [10.133.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld

AddedInterface

Add eth0 [10.133.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-a-8d612c-openshift-default-84d87678c7

SuccessfulCreate

Created pod: e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-8d612c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-8d612c

openshift-ingress

deployment-controller

e2e-extmod-a-8d612c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-8d612c-openshift-default-84d87678c7 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

AddedInterface

Add eth0 [10.133.0.175/23] from ovn-kubernetes
(x9)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-98a19b-openshift-default

SuccessfulRescale

(combined from similar events): New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-b-w4-b91df1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-b91df1-openshift-default-85bff8b855 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-b91df1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-b91df1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855

SuccessfulCreate

Created pod: e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

openshift-ingress

deployment-controller

e2e-worker-w1-98a19b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-98a19b-openshift-default-775879c667 from 2 to 1

openshift-ingress

multus

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-8d612c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-8d612c-594697bf6 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-cr258

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8d612c: serviceaccount "payload-processing-e2e-extmod-a-8d612c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-8d612c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-8d612c-74c797d987 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8d612c-594697bf6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-8d612c-594697bf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-8d612c: serviceaccount "payload-processing-e2e-extmod-a-8d612c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-8d612c-594697bf6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg

AddedInterface

Add eth0 [10.133.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-b91df1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-b91df1-765b88fb56 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-b91df1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-b91df1: serviceaccount "payload-processing-e2e-shared-b-w4-b91df1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-b91df1: serviceaccount "payload-processing-e2e-shared-b-w4-b91df1" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb

AddedInterface

Add eth0 [10.133.0.179/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-79c649

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-79c649

openshift-ingress

multus

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-79c649-openshift-default-756c8b9d99

SuccessfulCreate

Created pod: e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

openshift-ingress

deployment-controller

e2e-autores-79c649-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-79c649-openshift-default-756c8b9d99 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0e72bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0e72bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-79c649-7955c4d77f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-79c649

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-79c649-7955c4d77f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-79c649-7955c4d77f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-79c649-7955c4d77f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-79c649: serviceaccount "payload-processing-e2e-autores-79c649" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-79c649

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-79c649-5cf6767768 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-79c649-5cf6767768

SuccessfulCreate

Created pod: payload-processing-e2e-autores-79c649-5cf6767768-nl4l6
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-79c649-5cf6767768

FailedCreate

Error creating: pods "payload-processing-e2e-autores-79c649-5cf6767768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-79c649: serviceaccount "payload-processing-e2e-autores-79c649" not found

openshift-ingress

multus

payload-processing-e2e-autores-79c649-5cf6767768-nl4l6

AddedInterface

Add eth0 [10.134.0.165/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

ProbeError

Startup probe error: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-79c649-5cf6767768-nl4l6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-79c649-5cf6767768-nl4l6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-79c649-5cf6767768-nl4l6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

Unhealthy

Startup probe failed: Get "http://10.133.0.171:15021/healthz/ready": dial tcp 10.133.0.171:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0e72bd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-0e72bd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

ProbeError

Readiness probe error: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

Unhealthy

Readiness probe failed: Get "http://10.133.0.175:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

ProbeError

Readiness probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

Unhealthy

Readiness probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-e391de-openshift-default-55f885987c

SuccessfulCreate

Created pod: e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b91df1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-e391de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e391de-openshift-default-55f885987c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-e391de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-e391de
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b91df1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

ProbeError

Startup probe error: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

Unhealthy

Startup probe failed: Get "http://10.133.0.175:15021/healthz/ready": dial tcp 10.133.0.175:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

Unhealthy

Startup probe failed: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

ProbeError

Startup probe error: Get "http://10.134.0.155:15021/healthz/ready": dial tcp 10.134.0.155:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

Unhealthy

Startup probe failed: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

ProbeError

Startup probe error: Get "http://10.134.0.154:15021/healthz/ready": dial tcp 10.134.0.154:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8d612c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8d612c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-e391de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-e391de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-e391de-84648dcdf6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e391de: serviceaccount "payload-processing-e2e-extmod-b-e391de" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e391de-84648dcdf6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e391de-84648dcdf6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-e391de-84648dcdf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e391de: serviceaccount "payload-processing-e2e-extmod-b-e391de" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7

openshift-ingress

multus

payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx

AddedInterface

Add eth0 [10.134.0.167/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8d612c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-8d612c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9389b9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9389b9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b91df1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-b91df1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9389b9-67dfc7496c-fq2ld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9389b9-589ddf7656-4l682

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-8d612c-74c797d987-9mbvg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

Unhealthy

Readiness probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

ProbeError

Readiness probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-79c649-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-79c649-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-79c649-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-79c649-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-autores-79c649-5cf6767768-nl4l6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

ProbeError

Startup probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

Unhealthy

Startup probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e391de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e391de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-autores-79c649-openshift-default-756c8b9d99-cf2pz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-46dadd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-46dadd-openshift-default-5d8878cbbf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-46dadd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-46dadd

openshift-ingress

replicaset-controller

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf

SuccessfulCreate

Created pod: e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

openshift-ingress

multus

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-742ff8-openshift-default-77b774b865-xf6fl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-8d612c-openshift-default-84d87678c7-gpp9d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-46dadd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-46dadd-6f9b4797d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-46dadd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-46dadd-6f9b4797d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-46dadd-6f9b4797d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-46dadd: serviceaccount "payload-processing-e2e-extmod-a-46dadd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-46dadd: serviceaccount "payload-processing-e2e-extmod-a-46dadd" not found

openshift-ingress

multus

payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls

AddedInterface

Add eth0 [10.134.0.173/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt

AddedInterface

Add eth0 [10.134.0.172/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-46dadd-6f9b4797d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-b91df1-5c7bbf65f-vvg2l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-b91df1-765b88fb56-l2xpb

Killing

Stopping container payload-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e391de-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e391de-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-487c5f-8498b9b5bc-vmsh6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-487c5f-7875df5768-7lbcn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-cafbb2-68549d456b-t2xwh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-cafbb2-549d67b8c5-qg7k5

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe49e7-6bb448b78c-v4rcq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe49e7-7864f67bd-mtx2s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-b37684-77fcd69c56-6ns9w

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.253:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-b37684-5674b77867-mv74k

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.252:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-0e72bd-openshift-default-ff466bf5c-xmjds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-extmod-b-273c1b-openshift-default-5585576597

SuccessfulCreate

Created pod: e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

openshift-ingress

deployment-controller

e2e-extmod-b-273c1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-273c1b-openshift-default-5585576597 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-273c1b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-273c1b

openshift-ingress

multus

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

AddedInterface

Add eth0 [10.134.0.174/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-bbfa07-658b9f6ff5-qxnqd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-bbfa07-5d784fb568-6ddcf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

ProbeError

Readiness probe error: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Unhealthy

Readiness probe failed: Get "http://10.134.0.169:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-273c1b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-273c1b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-273c1b-7df95585d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-273c1b-7df95585d6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-273c1b-7df95585d6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-273c1b-7df95585d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-273c1b: serviceaccount "payload-processing-e2e-extmod-b-273c1b" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-273c1b: serviceaccount "payload-processing-e2e-extmod-b-273c1b" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

AddedInterface

Add eth0 [10.134.0.176/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr

AddedInterface

Add eth0 [10.134.0.177/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-98a19b-779f877d8-hgncx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-46dadd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-46dadd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-e391de-openshift-default-55f885987c-qs9ms

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-46dadd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-46dadd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-547082-74fc5b6748-rnbv2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-547082-7f5584658c-gcnvp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w4-4ec609-openshift-default-66fc5976ff-2bcq4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-98a19b-openshift-default-775879c667-j22qx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-547082-openshift-default-c85f94499-pq8lj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-273c1b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-273c1b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

Unhealthy

Startup probe failed: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

ProbeError

Startup probe error: Get "http://10.134.0.174:15021/healthz/ready": dial tcp 10.134.0.174:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-e4864d-67698fc88c-t6ft7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-273c1b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-273c1b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-a74d15-openshift-default-6659bdd657-ml9rx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-056a27-openshift-default-79ff5c986f-fblgh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-64120b-openshift-default-6dff766d79-slxqk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-64120b-59d74fc496-ttj7n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-64120b-59c4c64895-tbsbb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-b0a183-5f4f79ff84-pwfs7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503