Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp to ip-10-0-139-90.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-q57nl

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-q57nl to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7 to ip-10-0-134-12.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-q6sw7

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-q6sw7 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-lcg5t

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-lcg5t to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r to ip-10-0-134-12.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-wmm6t

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-wmm6t to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72 to ip-10-0-139-90.us-east-2.compute.internal

kuadrant-system

authorino-5b56ffbcf8-d4flt

Scheduled

Successfully assigned kuadrant-system/authorino-5b56ffbcf8-d4flt to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-rxx4q

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-rxx4q to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

authorino-6f6944bcdd-zmwhg

Scheduled

Successfully assigned kuadrant-system/authorino-6f6944bcdd-zmwhg to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-gbxpn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-gbxpn to ip-10-0-134-12.us-east-2.compute.internal

kuadrant-system

authorino-c989b787c-nvj7f

Scheduled

Successfully assigned kuadrant-system/authorino-c989b787c-nvj7f to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-k95vx

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-k95vx to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-94kvg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-94kvg to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-9mtdw to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

ai-gateway-controller-5d8dddb676-2ts72

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-5d8dddb676-2ts72 to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

ai-gateway-controller-6b675dd85b-h27pj

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6b675dd85b-h27pj to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-xmpx9

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-xmpx9 to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-c2657

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-c2657 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-sb26w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-sb26w to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-w8jg4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-w8jg4 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-xm7qt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xm7qt to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-rsn52

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-rsn52 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-5cb777df86-9cpw5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cb777df86-9cpw5 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-5cb777df86-kcgc4

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5cb777df86-kcgc4 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-4s98l

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s98l to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-5p4bj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5p4bj to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-74hrv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-74hrv to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-7h7sb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-7h7sb to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-7hrjn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-7hrjn to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b9tw2 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-c7n4c to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-vrn6v

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-vrn6v to ip-10-0-138-233.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-b7xzs

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-b7xzs to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

maas-controller-67566d777-jjbdl

Scheduled

Successfully assigned opendatahub/maas-controller-67566d777-jjbdl to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

maas-controller-6fdb79d597-9n4gw

Scheduled

Successfully assigned opendatahub/maas-controller-6fdb79d597-9n4gw to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-kjdj9

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-kjdj9 to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-8lglj

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-8lglj to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

test-curl-7600-1f367c

Scheduled

Successfully assigned opendatahub/test-curl-7600-1f367c to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-d7gsx to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-fcrct

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-fcrct to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-fv94c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-fv94c to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-fwgj9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-fwgj9 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-hs9mc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-hs9mc to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-lrmsr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-lrmsr to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-n7vfj

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-n7vfj to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-tfb77

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tfb77 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-tq59l

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tq59l to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-vkhvr to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-jjvlt

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-jjvlt to ip-10-0-138-233.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-8bb6cf694-ttfc8

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-8bb6cf694-ttfc8 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

test-curl-7600-2136b0

Scheduled

Successfully assigned opendatahub/test-curl-7600-2136b0 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

router-default-788447d7cc-tl5jd

Scheduled

Successfully assigned openshift-ingress/router-default-788447d7cc-tl5jd to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

router-default-788447d7cc-tl5jd

FailedScheduling

no nodes available to schedule pods

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-klrdr

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-klrdr to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

test-curl-7600-53c342

Scheduled

Successfully assigned opendatahub/test-curl-7600-53c342 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

router-default-788447d7cc-tl5jd

FailedScheduling

no nodes available to schedule pods

models-as-a-service

payload-processing-external-model-855b7646c4-fnxx9

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-855b7646c4-fnxx9 to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

test-curl-7600-7b8f81

Scheduled

Successfully assigned opendatahub/test-curl-7600-7b8f81 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-8whrk

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-8whrk to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-xkl44

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-xkl44 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f to ip-10-0-134-12.us-east-2.compute.internal

openshift-jobset-operator

jobset-controller-manager-664b6d8b68-22426

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-664b6d8b68-22426 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-5kwcd

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-5kwcd to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7 to ip-10-0-138-233.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-82pqb

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-82pqb to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

Scheduled

Successfully assigned openshift-ingress/e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-rh242 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-p75w4 to ip-10-0-134-12.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-4shtg

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-4shtg to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-hprq7 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-8pk88 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-552v8 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn to ip-10-0-138-233.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s to ip-10-0-138-233.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-2xhzm to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5 to ip-10-0-134-12.us-east-2.compute.internal

cert-manager

cert-manager-597b95cb84-m8lgd

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-m8lgd to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp to ip-10-0-134-12.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-bpt97

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-bpt97 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4 to ip-10-0-134-12.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-x9t8q to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b13404-openshift-default-7d5579f55-jf495 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr to ip-10-0-134-12.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-055d82-openshift-default-79544dc787-q64dp to ip-10-0-138-233.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-lrkj6

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-lrkj6 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-055d82-openshift-default-79544dc787-jbsql to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-055d82-openshift-default-79544dc787-bln7k to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-55fbbbf9dc-2f7kn

Scheduled

Successfully assigned openshift-ingress/payload-processing-55fbbbf9dc-2f7kn to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-afe85416-77455b99f-ffk64

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-afe85416-77455b99f-ffk64 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-273012-8665bbb447-4h8kx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-273012-8665bbb447-4h8kx to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj to ip-10-0-139-90.us-east-2.compute.internal

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws to ip-10-0-134-12.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-b13404-766b656b97-mngzq to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj to ip-10-0-139-90.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5944845765-fcr4c

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5944845765-fcr4c to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr to ip-10-0-138-233.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5bc8c6dfc6-w8x5p

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5bc8c6dfc6-w8x5p to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh to ip-10-0-139-90.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5f57c946bf-9gvjt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5f57c946bf-9gvjt to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h to ip-10-0-139-90.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-68fb489997-rw4h2

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-68fb489997-rw4h2 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz to ip-10-0-134-12.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6b76f7948b-5t8cf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6b76f7948b-5t8cf to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8 to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l to ip-10-0-138-233.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-74b7555969-5m79x

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-74b7555969-5m79x to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442 to ip-10-0-138-233.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-74b7555969-r8628

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-74b7555969-r8628 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj to ip-10-0-138-233.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-8444774d4b-b2wgn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-8444774d4b-b2wgn to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-642fe5-openshift-default-76fb996475-967bc to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-38c9b0-openshift-default-778969b477-d74m2 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th to ip-10-0-134-12.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-8444774d4b-dvzrf

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-8444774d4b-dvzrf to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-141053-openshift-default-6694f679f7-2vzmm to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-549f9d654fn6gpr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-549f9d654fn6gpr to ip-10-0-138-233.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6688c64986-t7jsc

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6688c64986-t7jsc to ip-10-0-134-12.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6688c64986-lb282

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6688c64986-lb282 to ip-10-0-138-233.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-855b7646c4-27w2s

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-855b7646c4-27w2s to ip-10-0-138-233.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-6688c64986-ftpqx

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-6688c64986-ftpqx to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9pz5c to ip-10-0-139-90.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

test-curl-7609-3410cd

Scheduled

Successfully assigned opendatahub/test-curl-7609-3410cd to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

test-curl-7603-64cfdb

Scheduled

Successfully assigned opendatahub/test-curl-7603-64cfdb to ip-10-0-134-12.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-855b7646c4-2wc6s

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-855b7646c4-2wc6s to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

test-curl-7603-2f99f8

Scheduled

Successfully assigned opendatahub/test-curl-7603-2f99f8 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

test-curl-7600-ba4287

Scheduled

Successfully assigned opendatahub/test-curl-7600-ba4287 to ip-10-0-134-12.us-east-2.compute.internal

opendatahub

test-curl-7600-b9ee02

Scheduled

Successfully assigned opendatahub/test-curl-7600-b9ee02 to ip-10-0-134-12.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv to ip-10-0-138-233.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-855b7646c4-449q9

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-855b7646c4-449q9 to ip-10-0-138-233.us-east-2.compute.internal

opendatahub

test-curl-7600-b41f69

Scheduled

Successfully assigned opendatahub/test-curl-7600-b41f69 to ip-10-0-139-90.us-east-2.compute.internal

opendatahub

test-curl-7600-9feb67

Scheduled

Successfully assigned opendatahub/test-curl-7600-9feb67 to ip-10-0-139-90.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-l2h46

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-l2h46 to ip-10-0-138-233.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-788447d7cc from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-788447d7cc

SuccessfulCreate

Created pod: router-default-788447d7cc-tl5jd
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-788447d7cc-tl5jd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-788447d7cc-tl5jd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x4)

openshift-ingress

kubelet

router-default-788447d7cc-tl5jd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-788447d7cc-tl5jd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-788447d7cc-tl5jd

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-788447d7cc-tl5jd

Started

Container started

openshift-ingress

kubelet

router-default-788447d7cc-tl5jd

Created

Container created

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-gbxpn

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-gbxpn

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gbxpn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gbxpn

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gbxpn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.128s (3.128s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gbxpn

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gbxpn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gbxpn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-c7n4c

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-95cb67c75

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-95cb67c75 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-c7n4c

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.234s (11.234s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-95cb67c75-n5s48

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 10.733s (10.733s including waiting). Image size: 183555333 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-l2h46

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-l2h46

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-l2h46

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-l2h46

Created

Container created

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-l2h46

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.123s (2.123s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-l2h46

Started

Container started

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-l2h46_475e27d7-b2f4-4481-ac31-5fabdec2d960 became leader
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6688c64986-t7jsc

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-6688c64986 from 0 to 3

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-k95vx

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6688c64986

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6688c64986-t7jsc

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6688c64986

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6688c64986-ftpqx

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6688c64986-lb282

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-6688c64986

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-6688c64986-lb282

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-6688c64986-ftpqx

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k95vx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

multus

authorino-operator-7b7bb4bc77-k95vx

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

operator-lifecycle-manager

install-2dk2b

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.158s (3.158s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.915s (2.915s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 384ms (384ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.324s (3.324s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Started

Container started

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k95vx

Started

Container started
(x3)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k95vx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 2.978s (2.978s including waiting). Image size: 167738465 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-t7jsc

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 410ms (410ms including waiting). Image size: 273709574 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-k95vx

Created

Container created

kuadrant-system

authorino-operator-7b7bb4bc77-k95vx_d25d8160-3187-4e96-89a6-db8bc2767b1b

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-k95vx_d25d8160-3187-4e96-89a6-db8bc2767b1b became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-lb282

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 412ms (412ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

opendatahub-operator-controller-manager-6688c64986-lb282_4f7335c2-8fb6-4ed8-a4d1-939de9e84953

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-6688c64986-lb282_4f7335c2-8fb6-4ed8-a4d1-939de9e84953 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-6688c64986-ftpqx

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-8whrk

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-8whrk

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-8whrk

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-vrn6v

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-8whrk

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-8whrk

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-8whrk

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.546s (4.546s including waiting). Image size: 424244516 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-vrn6v

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-vrn6v

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-8whrk_c679dd49-3118-4046-a88e-18ad1c5c7721

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-8whrk_c679dd49-3118-4046-a88e-18ad1c5c7721 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-jjvlt

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jjvlt

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-jjvlt

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-vrn6v

Started

Container started

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-vrn6v

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.793s (2.793s including waiting). Image size: 190804149 bytes.

kuadrant-system

dns-operator-controller-manager-8557cbdb84-vrn6v_08bdc0f0-efcb-4fae-ad34-5d769e617b73

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-vrn6v_08bdc0f0-efcb-4fae-ad34-5d769e617b73 became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-vrn6v

Created

Container created

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-4shtg

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-q6sw7

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4shtg

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-q6sw7

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q6sw7

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-4shtg

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4shtg

Started

Container started

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-q57nl

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4shtg

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.689s (1.689s including waiting). Image size: 177967631 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q57nl

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

limitador-operator-controller-manager-5778bb4449-4shtg_54ef6a8f-aebe-496f-b6c8-3ae8753220b3

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-4shtg_54ef6a8f-aebe-496f-b6c8-3ae8753220b3 became leader

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-q57nl

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-4shtg

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jjvlt

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jjvlt

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-jjvlt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.918s (4.918s including waiting). Image size: 342538866 bytes.

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q57nl

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q6sw7

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q57nl

Started

Container started

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-q57nl

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.696s (2.696s including waiting). Image size: 309650901 bytes.
(x11)

cert-manager

replicaset-controller

cert-manager-597b95cb84

FailedCreate

Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q6sw7

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.651s (3.651s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-q6sw7

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-klrdr

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-klrdr

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-klrdr

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-597b95cb84-m8lgd

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

kubelet

cert-manager-597b95cb84-m8lgd

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-m8lgd

Created

Container created

cert-manager

multus

cert-manager-597b95cb84-m8lgd

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-m8lgd

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-klrdr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.518s (4.518s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-klrdr

Started

Container started

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-klrdr

Created

Container created

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-5cb777df86

SuccessfulCreate

Created pod: kube-auth-proxy-5cb777df86-kcgc4

openshift-ingress

replicaset-controller

kube-auth-proxy-5cb777df86

SuccessfulCreate

Created pod: kube-auth-proxy-5cb777df86-9cpw5

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5cb777df86 from 0 to 2

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fn6gpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-549f9d654f from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-549f9d654f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-549f9d654fn6gpr

openshift-ingress

multus

kube-auth-proxy-5cb777df86-kcgc4

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fn6gpr

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-kcgc4

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-549f9d654fn6gpr

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-549f9d654fn6gpr

Created

Container created

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-9cpw5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

kube-auth-proxy-5cb777df86-9cpw5

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

authorino-57f7f8659f-wmm6t

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-wmm6t

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-wmm6t

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-9cpw5

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-kcgc4

Started

Container started

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-c2657

kuadrant-system

kubelet

authorino-57f7f8659f-wmm6t

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-kcgc4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.793s (2.793s including waiting). Image size: 188904677 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-wmm6t

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.028s (2.028s including waiting). Image size: 204096810 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-9cpw5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.481s (2.481s including waiting). Image size: 188904677 bytes.

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-9cpw5

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-c2657

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

openshift-ingress

kubelet

kube-auth-proxy-5cb777df86-kcgc4

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-wmm6t

Started

Container started

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-c2657

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-c2657

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.913s (2.913s including waiting). Image size: 195729000 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-c2657

Started

Container started

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-c2657

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-8whrk

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-8whrk

Killing

Stopping container manager

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-885w8"

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-qxcss"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-664b6d8b68

SuccessfulCreate

Created pod: jobset-controller-manager-664b6d8b68-22426

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-664b6d8b68 from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

kubelet

jobset-controller-manager-664b6d8b68-22426

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

multus

jobset-controller-manager-664b6d8b68-22426

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

opendatahub

kserve-module-controller-manager-7566cf5fc8-c2657_0fb55313-03c5-42bb-8696-a18cd3fc0a14

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-c2657_0fb55313-03c5-42bb-8696-a18cd3fc0a14 became leader

openshift-jobset-operator

jobset-controller-manager-664b6d8b68-22426_c4b483ac-e59d-43c1-92be-6924cd00935e

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-664b6d8b68-22426_c4b483ac-e59d-43c1-92be-6924cd00935e became leader

openshift-jobset-operator

kubelet

jobset-controller-manager-664b6d8b68-22426

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.18s (3.18s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

kubelet

jobset-controller-manager-664b6d8b68-22426

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-664b6d8b68-22426

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-klrdr_debfd693-4658-43f4-9819-d38fb8e711b0

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-klrdr_debfd693-4658-43f4-9819-d38fb8e711b0 became leader

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-lcg5t
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

multus

authorino-56c6c9ddd5-lcg5t

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-5kwcd

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-5kwcd

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-82pqb

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-82pqb

kuadrant-system

kubelet

authorino-56c6c9ddd5-lcg5t

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

limitador-limitador-74dfcfb894-5kwcd

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-7c9b87d574-82pqb

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-lcg5t

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-lcg5t

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 824ms (824ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-56c6c9ddd5-lcg5t

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

kubelet

authorino-57f7f8659f-wmm6t

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-82pqb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.255s (1.255s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-82pqb

Started

Container started

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-wmm6t

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-82pqb

Created

Container created

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-5kwcd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.798s (2.798s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-5kwcd

Started

Container started

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-5kwcd

Created

Container created

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-5kwcd

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-5kwcd

opendatahub

kubelet

model-serving-api-75bd89fdfc-kjdj9

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

multus

odh-model-controller-769875db56-8lglj

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-b7xzs

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b7xzs

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

model-serving-api-75bd89fdfc-kjdj9

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

opendatahub

kubelet

odh-model-controller-769875db56-8lglj

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-xm7qt

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xmpx9

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-b7xzs

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-xmpx9

opendatahub

multus

kserve-controller-manager-776cc66d47-xmpx9

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xm7qt

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xm7qt

Created

Container created

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-kjdj9

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-8lglj

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-xm7qt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-xm7qt

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-gbxpn

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-gbxpn

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

model-serving-api-75bd89fdfc-kjdj9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 2.182s (2.182s including waiting). Image size: 184925761 bytes.

opendatahub

kserve-controller-manager-776cc66d47-xmpx9_22bdc237-9d6b-4937-a07b-fb5e71621557

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-xmpx9_22bdc237-9d6b-4937-a07b-fb5e71621557 became leader

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xmpx9

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-8lglj

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b7xzs

Created

Container created

opendatahub

kubelet

odh-model-controller-769875db56-8lglj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.996s (2.996s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xmpx9

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.508s (2.508s including waiting). Image size: 247676581 bytes.

opendatahub

kubelet

odh-model-controller-769875db56-8lglj

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-xmpx9

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b7xzs

Started

Container started

opendatahub

odh-model-controller-769875db56-8lglj_ca6f6ebe-4b77-4c72-8435-c1849fbb352a

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-8lglj_ca6f6ebe-4b77-4c72-8435-c1849fbb352a became leader

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b7xzs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.291s (2.291s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-kjdj9

Started

Container started

opendatahub

kubelet

model-serving-api-75bd89fdfc-kjdj9

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-b7xzs_204ce606-a588-444f-9246-fa34df1cc627

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-b7xzs_204ce606-a588-444f-9246-fa34df1cc627 became leader

opendatahub

multus

maas-controller-67566d777-jjbdl

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

opendatahub

replicaset-controller

maas-controller-6fdb79d597

SuccessfulCreate

Created pod: maas-controller-6fdb79d597-9n4gw

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-6fdb79d597 from 0 to 1

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-67566d777 from 0 to 1

opendatahub

replicaset-controller

maas-controller-67566d777

SuccessfulCreate

Created pod: maas-controller-67566d777-jjbdl

opendatahub

kubelet

maas-controller-67566d777-jjbdl

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:194dc1bab10953375b883007f15a58097e7e139be21ced6fc36e07e4ee848118"

opendatahub

kubelet

maas-controller-6fdb79d597-9n4gw

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:194dc1bab10953375b883007f15a58097e7e139be21ced6fc36e07e4ee848118"

opendatahub

multus

maas-controller-6fdb79d597-9n4gw

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-6fdb79d597-9n4gw

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:194dc1bab10953375b883007f15a58097e7e139be21ced6fc36e07e4ee848118" in 3.419s (3.419s including waiting). Image size: 200063996 bytes.

opendatahub

kubelet

maas-controller-67566d777-jjbdl

Created

Container created

opendatahub

kubelet

maas-controller-6fdb79d597-9n4gw

Created

Container created

opendatahub

kubelet

maas-controller-67566d777-jjbdl

Started

Container started

opendatahub

kubelet

maas-controller-6fdb79d597-9n4gw

Started

Container started

opendatahub

kubelet

maas-controller-67566d777-jjbdl

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:194dc1bab10953375b883007f15a58097e7e139be21ced6fc36e07e4ee848118" in 3.905s (3.905s including waiting). Image size: 200063996 bytes.
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

maas-controller-67566d777-jjbdl_91c92cfd-d899-41a2-9790-b7fffaf98a37

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-67566d777-jjbdl_91c92cfd-d899-41a2-9790-b7fffaf98a37 became leader
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

FailedMount

MountVolume.SetUp failed for volume "tls-cert" : secret "usage-logs-tenancy-proxy-tls" not found

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-67566d777 from 1 to 0

opendatahub

replicaset-controller

maas-controller-67566d777

SuccessfulDelete

Deleted pod: maas-controller-67566d777-jjbdl

opendatahub

kubelet

maas-controller-67566d777-jjbdl

Killing

Stopping container manager

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.499s (11.499s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-9pz5c

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

maas-controller-6fdb79d597-9n4gw_90273b6c-9776-4641-ac7b-f2de38f5cb1a

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-6fdb79d597-9n4gw_90273b6c-9776-4641-ac7b-f2de38f5cb1a became leader

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6f6944bcdd from 1 to 0
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Created

Container created

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-rxx4q

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulDelete

Deleted pod: authorino-6f6944bcdd-zmwhg

kuadrant-system

replicaset-controller

authorino-6f6944bcdd

SuccessfulCreate

Created pod: authorino-6f6944bcdd-zmwhg

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6f6944bcdd from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-rxx4q

kuadrant-system

multus

authorino-c989b787c-nvj7f

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-rxx4q

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

replicaset-controller

authorino-c989b787c

SuccessfulCreate

Created pod: authorino-c989b787c-nvj7f

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-c989b787c from 0 to 1

kuadrant-system

kubelet

authorino-c989b787c-nvj7f

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6889cbd8c4-rxx4q

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-rxx4q

Created

Container created

kuadrant-system

kubelet

authorino-6889cbd8c4-rxx4q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.031s (1.031s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-rxx4q

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-rxx4q

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-c989b787c-nvj7f

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 991ms (991ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-c989b787c-nvj7f

Created

Container created

kuadrant-system

kubelet

authorino-c989b787c-nvj7f

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

kubelet

authorino-56c6c9ddd5-lcg5t

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-lcg5t

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-rsn52

opendatahub

multus

llmisvc-controller-manager-6466c554d8-rsn52

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

ProbeError

Startup probe error: Get "http://10.133.0.19:15021/healthz/ready": dial tcp 10.133.0.19:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Unhealthy

Startup probe failed: Get "http://10.133.0.19:15021/healthz/ready": dial tcp 10.133.0.19:15021: connect: connection refused

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rsn52

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 379ms (379ms including waiting). Image size: 235100981 bytes.
(x2)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rsn52

Started

Container started
(x2)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rsn52

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rsn52

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 477ms (477ms including waiting). Image size: 235100981 bytes.
(x2)

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-rsn52

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-b7xzs

Killing

Stopping container manager

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-b7xzs

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulCreate

Created pod: ai-gateway-controller-5d8dddb676-2ts72

opendatahub

multus

ai-gateway-controller-5d8dddb676-2ts72

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-5d8dddb676 from 0 to 1

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-2ts72

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-2ts72

Created

Container created

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-2ts72

Started

Container started

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-2ts72

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 3.671s (3.671s including waiting). Image size: 183979430 bytes.

opendatahub

ai-gateway-controller-5d8dddb676-2ts72_a65916b9-79c0-4986-b37b-bcc088c5299d

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-5d8dddb676-2ts72_a65916b9-79c0-4986-b37b-bcc088c5299d became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-55fbbbf9dc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

FailedCreate

Error creating: pods "payload-processing-55fbbbf9dc-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-xkl44

openshift-ingress

replicaset-controller

payload-processing-55fbbbf9dc

SuccessfulCreate

Created pod: payload-processing-55fbbbf9dc-2f7kn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-7b98bb678c-xkl44

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-2f7kn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-55fbbbf9dc-2f7kn

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xkl44

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xkl44

Created

Container created

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-2f7kn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.473s (2.473s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xkl44

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.407s (2.407s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-xkl44

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-2f7kn

Started

Container started

openshift-ingress

kubelet

payload-processing-55fbbbf9dc-2f7kn

Created

Container created

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6b675dd85b from 0 to 1

opendatahub

llmisvc-controller-manager-6466c554d8-rsn52_ed351990-4617-49d7-a104-483f72224af2

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-rsn52_ed351990-4617-49d7-a104-483f72224af2 became leader

opendatahub

kubelet

ai-gateway-controller-6b675dd85b-h27pj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

replicaset-controller

ai-gateway-controller-6b675dd85b

SuccessfulCreate

Created pod: ai-gateway-controller-6b675dd85b-h27pj

opendatahub

multus

ai-gateway-controller-6b675dd85b-h27pj

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6b675dd85b-h27pj

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6b675dd85b-h27pj

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6b675dd85b-h27pj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 433ms (433ms including waiting). Image size: 183979430 bytes.

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-5d8dddb676 from 1 to 0

opendatahub

replicaset-controller

ai-gateway-controller-5d8dddb676

SuccessfulDelete

Deleted pod: ai-gateway-controller-5d8dddb676-2ts72

opendatahub

kubelet

ai-gateway-controller-5d8dddb676-2ts72

Killing

Stopping container manager

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.492s (1.492s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-s7nj5

Started

Container started

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-bpt97

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bpt97

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.503s (1.503s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bpt97

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

Created

Container created

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-bpt97

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bpt97

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-bpt97

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 301ms (301ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-lrkj6

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

Started

Container started

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

Created

Container created

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 291ms (291ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4

Started

Container started

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8vtck4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 302ms (302ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lrkj6

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

multus

echo-simulator-kserve-64b6f8f96c-lrkj6

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

opendatahub

ai-gateway-controller-6b675dd85b-h27pj_209df502-9f53-4ee8-9a94-3847e16e625b

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6b675dd85b-h27pj_209df502-9f53-4ee8-9a94-3847e16e625b became leader

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 289ms (289ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r

Started

Container started

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-h8g8r

Created

Container created

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 298ms (298ms including waiting). Image size: 98346788 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Created

Container created

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lrkj6

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.747s (1.747s including waiting). Image size: 78208878 bytes.

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lrkj6

Started

Container started

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lrkj6

Created

Container created

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

kuadrant-system

kubelet

authorino-5b56ffbcf8-d4flt

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

replicaset-controller

authorino-5b56ffbcf8

SuccessfulCreate

Created pod: authorino-5b56ffbcf8-d4flt

kuadrant-system

multus

authorino-5b56ffbcf8-d4flt

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-5b56ffbcf8-d4flt

Started

Container started

kuadrant-system

kubelet

authorino-5b56ffbcf8-d4flt

Created

Container created

kuadrant-system

kubelet

authorino-5b56ffbcf8-d4flt

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.16s (1.16s including waiting). Image size: 204096810 bytes.

kuadrant-system

replicaset-controller

authorino-c989b787c

SuccessfulDelete

Deleted pod: authorino-c989b787c-nvj7f

kuadrant-system

kubelet

authorino-c989b787c-nvj7f

Killing

Stopping container authorino
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-c989b787c from 1 to 0

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-d7gsx

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-b9tw2

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-b9tw2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-d7gsx

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-tfb77

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-tfb77

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 1 to 4

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tfb77

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.055s (3.055s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tfb77

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.435s (3.435s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tfb77

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tfb77

Started

Container started
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tfb77

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tfb77

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5p4bj

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-lrmsr

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lrmsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5p4bj

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-tq59l

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5p4bj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-5p4bj

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lrmsr

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-5p4bj

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-tq59l

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-7h7sb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-lrmsr

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lrmsr

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-7h7sb

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lrmsr

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lrmsr

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5p4bj

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5p4bj

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-74hrv

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-74hrv

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-74hrv

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 8 to 9

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-74hrv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-74hrv

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-74hrv

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-74hrv

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-3a6822cf-openshift-default-5cdf876bc9

SuccessfulCreate

Created pod: e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

openshift-ingress

gateway_labeler_controller

e2e-ait-3a6822cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3a6822cf

openshift-ingress

deployment-controller

e2e-migrate-3baa762a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-3baa762a-gw-openshift-default-6474774769 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-3baa762a-gw-openshift-default-6474774769

SuccessfulCreate

Created pod: e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

openshift-ingress

deployment-controller

e2e-ait-3a6822cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3a6822cf-openshift-default-5cdf876bc9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-3baa762a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-3baa762a-gw

openshift-ingress

multus

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3baa762a-6bb7f579f5

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-3baa762a-6bb7f579f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3baa762a: serviceaccount "payload-processing-e2e-migrate-3baa762a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3baa762a-6bb7f579f5

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-3baa762a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-3baa762a-6bb7f579f5 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3baa762a-d4698489f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-3baa762a-d4698489f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3baa762a: serviceaccount "payload-processing-e2e-migrate-3baa762a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3baa762a-d4698489f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-3baa762a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-3baa762a-d4698489f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3a6822cf-7b547f6cd9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3a6822cf-7b547f6cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3a6822cf: serviceaccount "payload-processing-e2e-ait-3a6822cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3a6822cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3a6822cf-6bd974f755 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3a6822cf: serviceaccount "payload-processing-e2e-ait-3a6822cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3a6822cf-7b547f6cd9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

openshift-ingress

kubelet

payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3a6822cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3a6822cf-7b547f6cd9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb

openshift-ingress

multus

payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9

SuccessfulCreate

Created pod: e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

openshift-ingress

deployment-controller

e2e-derive-fc81ef02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-fc81ef02-openshift-default-69d9fc6bb9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-fc81ef02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-fc81ef02

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.891s (2.891s including waiting). Image size: 125353963 bytes.

openshift-ingress

multus

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-ait-19708dae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-19708dae

openshift-ingress

replicaset-controller

e2e-ait-19708dae-openshift-default-85bbdddd47

SuccessfulCreate

Created pod: e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

openshift-ingress

deployment-controller

e2e-ait-19708dae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-19708dae-openshift-default-85bbdddd47 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-fc81ef02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-fc81ef02-7c56555d69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-fc81ef02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fc81ef02-7c56555d69

FailedCreate

Error creating: pods "payload-processing-e2e-derive-fc81ef02-7c56555d69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fc81ef02: serviceaccount "payload-processing-e2e-derive-fc81ef02" not found

openshift-ingress

multus

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fc81ef02-7c56555d69

SuccessfulCreate

Created pod: payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8

openshift-ingress

gateway_labeler_controller

e2e-ait-afe85416

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-afe85416

openshift-ingress

multus

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn

openshift-ingress

kubelet

payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fc81ef02: serviceaccount "payload-processing-e2e-derive-fc81ef02" not found

openshift-ingress

deployment-controller

e2e-ait-afe85416-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-afe85416-openshift-default-75b5b9d5c7 from 0 to 1

openshift-ingress

multus

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-afe85416-openshift-default-75b5b9d5c7

SuccessfulCreate

Created pod: e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a6822cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-19708dae-85fbf668cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-19708dae-85fbf668cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-19708dae: serviceaccount "payload-processing-e2e-ait-19708dae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-afe85416

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-afe85416-77455b99f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-afe85416-77455b99f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-afe85416-77455b99f-ffk64

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-19708dae-b9dd77bfc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-19708dae-b9dd77bfc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-19708dae-b9dd77bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-19708dae: serviceaccount "payload-processing-e2e-ait-19708dae" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-19708dae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-19708dae-b9dd77bfc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-afe85416-77455b99f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-afe85416-77455b99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-afe85416: serviceaccount "payload-processing-e2e-ait-afe85416" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a6822cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-afe85416-6df9446b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-afe85416-6df9446b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-afe85416: serviceaccount "payload-processing-e2e-ait-afe85416" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-3baa762a-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-19708dae-85fbf668cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-3baa762a-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-19708dae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-19708dae-85fbf668cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-afe85416-6df9446b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-afe85416

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-afe85416-6df9446b99 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-afe85416-77455b99f-ffk64

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-afe85416-77455b99f-ffk64

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-afe85416-77455b99f-ffk64

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ait-afe85416-77455b99f-ffk64

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

Created

Container created

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-afe85416-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-afe85416-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

Created

Container created

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-migrate-3baa762a-6bb7f579f5-wgq9j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3baa762a-d4698489f-f7t9g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-3baa762a-gw-openshift-default-6474774769-mkspp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-b1c6f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-b1c6f6

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a6822cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-3a6822cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-fc81ef02-7c56555d69-gwxd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3a6822cf-7b547f6cd9-jfvvm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fc81ef02-7c6d4fcbcf-q6vmn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3a6822cf-6bd974f755-cftjb

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-b1c6f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-b1c6f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b1c6f6: serviceaccount "payload-processing-e2e-worker-w3-b1c6f6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-b1c6f6: serviceaccount "payload-processing-e2e-worker-w3-b1c6f6" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-fc81ef02-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-fc81ef02-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-19708dae-b9dd77bfc-988nr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-fc81ef02-openshift-default-69d9fc6bb9-57zwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-19708dae-85fbf668cf-jthf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-afe85416-77455b99f-ffk64

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-afe85416-6df9446b99-kzw85

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-19708dae-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-19708dae-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-010232

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-010232

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-3a6822cf-openshift-default-5cdf876bc9-xkfk8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-d5d3c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-d5d3c3

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-afe85416-openshift-default-75b5b9d5c7-pqzdd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-19708dae-openshift-default-85bbdddd47-5rldq

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f78621

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f78621

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-e78c33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-e78c33

openshift-ingress

replicaset-controller

e2e-worker-w0-f78621-openshift-default-74d8d5d569

SuccessfulCreate

Created pod: e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-f78621-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f78621-openshift-default-74d8d5d569 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-010232

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-010232-dd4979d95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-010232

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-010232-6bf5dbf45c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-d5d3c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-d5d3c3-748448dc75 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-010232-6bf5dbf45c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-010232-6bf5dbf45c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-010232-6bf5dbf45c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-010232: serviceaccount "payload-processing-e2e-worker-w1-010232" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-010232-dd4979d95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-010232-dd4979d95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-010232-dd4979d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-010232: serviceaccount "payload-processing-e2e-worker-w1-010232" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-d5d3c3-748448dc75

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-d5d3c3-748448dc75

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-d5d3c3-748448dc75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-d5d3c3: serviceaccount "payload-processing-e2e-worker-w4-d5d3c3" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-d5d3c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-d5d3c3: serviceaccount "payload-processing-e2e-worker-w4-d5d3c3" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e78c33: serviceaccount "payload-processing-e2e-worker-w2-e78c33" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-e78c33: serviceaccount "payload-processing-e2e-worker-w2-e78c33" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-e78c33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-e78c33-75cd6ff47c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

openshift-ingress

multus

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-e78c33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f78621: serviceaccount "payload-processing-e2e-worker-w0-f78621" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f78621-669d499979

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f78621-669d499979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f78621: serviceaccount "payload-processing-e2e-worker-w0-f78621" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f78621

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f78621-669d499979 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f78621

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f78621-669d499979

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": read tcp 10.134.0.2:41852->10.134.0.40:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": read tcp 10.134.0.2:41852->10.134.0.40:15021: read: connection reset by peer

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 1 to 2

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

Created

Container created

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w0-f78621-openshift-default-74d8d5d569

SuccessfulCreate

Created pod: e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w0-f78621-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f78621-openshift-default-74d8d5d569 from 1 to 2

openshift-ingress

multus

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 2 to 3

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5bc8c6dfc6 from 0 to 1
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc8c6dfc6

FailedCreate

Error creating: pods "payload-processing-external-model-5bc8c6dfc6-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc8c6dfc6

SuccessfulCreate

Created pod: payload-processing-external-model-5bc8c6dfc6-w8x5p

models-as-a-service

kubelet

payload-processing-external-model-5bc8c6dfc6-w8x5p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5bc8c6dfc6-w8x5p

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bc8c6dfc6-w8x5p

Created

Container created

models-as-a-service

multus

payload-processing-external-model-5bc8c6dfc6-w8x5p

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-8bb6cf694 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-8bb6cf694

SuccessfulCreate

Created pod: payload-processing-external-model-8bb6cf694-ttfc8

models-as-a-service

multus

payload-processing-external-model-8bb6cf694-ttfc8

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-8bb6cf694-ttfc8

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-8bb6cf694-ttfc8

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-8bb6cf694-ttfc8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 9 to 10

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-6cc458d887-4s98l

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-4s98l

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5bc8c6dfc6 from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-5bc8c6dfc6

SuccessfulDelete

Deleted pod: payload-processing-external-model-5bc8c6dfc6-w8x5p

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5bc8c6dfc6-w8x5p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 3 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

Created

Container created

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

Started

Container started

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-9mtdw
(x5)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

models-as-a-service

replicaset-controller

payload-processing-external-model-74b7555969

SuccessfulCreate

Created pod: payload-processing-external-model-74b7555969-5m79x
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-5m79x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-5m79x

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

multus

payload-processing-external-model-74b7555969-5m79x

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-5m79x

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.86s (4.86s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-9mtdw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

Created

Container created

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-8bb6cf694 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-8bb6cf694-ttfc8

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-8bb6cf694

SuccessfulDelete

Deleted pod: payload-processing-external-model-8bb6cf694-ttfc8

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-5944845765

SuccessfulCreate

Created pod: payload-processing-external-model-5944845765-fcr4c

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5944845765 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5944845765-fcr4c

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-5944845765-fcr4c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

models-as-a-service

multus

payload-processing-external-model-5944845765-fcr4c

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5944845765-fcr4c

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 3 to 6

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-74b7555969

SuccessfulDelete

Deleted pod: payload-processing-external-model-74b7555969-5m79x

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-5m79x

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-74b7555969 from 1 to 0
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-74b7555969 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-74b7555969

SuccessfulCreate

Created pod: payload-processing-external-model-74b7555969-r8628

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-r8628

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-r8628

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-r8628

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-74b7555969-r8628

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 3 to 5

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

models-as-a-service

kubelet

payload-processing-external-model-74b7555969-r8628

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-5944845765-fcr4c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 6 to 10

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

Started

Container started

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 8 to 10

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

Unhealthy

Startup probe failed: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

ProbeError

Startup probe error: Get "http://10.133.0.97:15021/healthz/ready": dial tcp 10.133.0.97:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 4 to 8

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

Created

Container created

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-x9t8q

Unhealthy

Readiness probe failed: Get "https://10.133.0.38:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

Created

Container created

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceNotReady

LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady
(x8)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

Unhealthy

Startup probe failed: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

ProbeError

Startup probe error: Get "http://10.133.0.103:15021/healthz/ready": dial tcp 10.133.0.103:15021: connect: connection refused body:
(x2)

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 5 to 10

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulCreate

Created pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

Created

Container created

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

Started

Container started

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

Created

Container created
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x9)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

ProbeError

Readiness probe error: Get "http://10.133.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

Unhealthy

Readiness probe failed: Get "http://10.133.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

ProbeError

Readiness probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Unhealthy

Readiness probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Unhealthy

Liveness probe failed: Get "https://10.133.0.40:8000/health": context deadline exceeded
(x2)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-mt-ab592834

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ab592834

openshift-ingress

deployment-controller

e2e-worker-w0-f78621-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f78621-openshift-default-74d8d5d569 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-f78621-openshift-default-74d8d5d569

SuccessfulCreate

Created pod: e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

openshift-ingress

replicaset-controller

e2e-worker-w0-f78621-openshift-default-74d8d5d569

SuccessfulCreate

Created pod: e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

Created

Container created

openshift-ingress

multus

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-ab592834-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ab592834-openshift-default-7f97f8769 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

Created

Container created

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ab592834-7b89945cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ab592834

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ab592834-7b89945cbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ab592834-6f7b8f6bc5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ab592834-6f7b8f6bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ab592834: serviceaccount "payload-processing-e2e-mt-ab592834" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ab592834-6f7b8f6bc5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ab592834

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ab592834-6f7b8f6bc5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ab592834-7b89945cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ab592834-7b89945cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ab592834: serviceaccount "payload-processing-e2e-mt-ab592834" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-141053-openshift-default-6694f679f7

SuccessfulCreate

Created pod: e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

openshift-ingress

gateway_labeler_controller

e2e-api-a-141053

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-141053

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

Started

Container started

openshift-ingress

deployment-controller

e2e-api-a-141053-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-141053-openshift-default-6694f679f7 from 0 to 1
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

multus

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-141053-6db8f5499f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-141053-6db8f5499f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-141053-6db8f5499f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-141053: serviceaccount "payload-processing-e2e-api-a-141053" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-141053-6f49fbc9bc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-141053-6f49fbc9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-141053: serviceaccount "payload-processing-e2e-api-a-141053" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-141053-6f49fbc9bc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-141053

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-141053-6f49fbc9bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-141053

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-141053-6db8f5499f from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ab592834-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ab592834-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk

AddedInterface

Add eth0 [10.133.0.113/23] from ovn-kubernetes
(x3)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Unhealthy

Liveness probe failed: Get "https://10.133.0.40:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-2xhzm

Unhealthy

Readiness probe failed: Get "https://10.133.0.37:8000/ready": context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2

AddedInterface

Add eth0 [10.133.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-141053-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-141053-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-api-a-151744-openshift-default-68fc44b48f

SuccessfulCreate

Created pod: e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

openshift-ingress

gateway_labeler_controller

e2e-api-a-151744

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-151744

openshift-ingress

deployment-controller

e2e-api-a-151744-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-151744-openshift-default-68fc44b48f from 0 to 1

openshift-ingress

multus

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

AddedInterface

Add eth0 [10.133.0.118/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-a917b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a917b1

openshift-ingress

deployment-controller

e2e-api-b-a917b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a917b1-openshift-default-7bb7654c89 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-a917b1-openshift-default-7bb7654c89

SuccessfulCreate

Created pod: e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

openshift-ingress

multus

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-151744-7bd85db9f5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-151744-7bd85db9f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-151744: serviceaccount "payload-processing-e2e-api-a-151744" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-151744

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-151744-7bd85db9f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-151744-7bd85db9f5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-151744-5964df88ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-151744-5964df88ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-151744: serviceaccount "payload-processing-e2e-api-a-151744" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-151744-5964df88ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-151744

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-151744-5964df88ff from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ab592834-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-mt-ab592834-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ab592834-openshift-default-7f97f8769 from 1 to 4

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

Started

Container started

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-rh242

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

Unhealthy

Startup probe failed: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

ProbeError

Startup probe error: Get "http://10.133.0.111:15021/healthz/ready": dial tcp 10.133.0.111:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a917b1-87b985f47

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a917b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a917b1-869f8fb44c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a917b1-87b985f47

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a917b1-87b985f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a917b1: serviceaccount "payload-processing-e2e-api-b-a917b1" not found
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a917b1: serviceaccount "payload-processing-e2e-api-b-a917b1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a917b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a917b1-87b985f47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ab592834-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ab592834-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-a-7d8392-openshift-default-7cf6f4f76c

SuccessfulCreate

Created pod: e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

openshift-ingress

gateway_labeler_controller

e2e-api-a-7d8392

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7d8392

openshift-ingress

deployment-controller

e2e-api-a-7d8392-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7d8392-openshift-default-7cf6f4f76c from 0 to 1

openshift-ingress

multus

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

gateway_labeler_controller

e2e-api-b-273012

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-273012

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-94kvg

openshift-ingress

replicaset-controller

e2e-api-b-273012-openshift-default-696fb5cfbf

SuccessfulCreate

Created pod: e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

openshift-ingress

deployment-controller

e2e-api-b-273012-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-273012-openshift-default-696fb5cfbf from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-94kvg

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-94kvg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

multus

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-141053-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-141053-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7d8392: serviceaccount "payload-processing-e2e-api-a-7d8392" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-94kvg

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7d8392

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7d8392-c5d8585cf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7d8392-fd6bdf685

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7d8392-fd6bdf685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7d8392: serviceaccount "payload-processing-e2e-api-a-7d8392" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7d8392-fd6bdf685

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7d8392

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7d8392-fd6bdf685 from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-94kvg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.177s (3.177s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-94kvg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-273012-59dcd47f9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr

openshift-ingress

multus

payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-273012-8665bbb447

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-273012-8665bbb447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-273012: serviceaccount "payload-processing-e2e-api-b-273012" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-273012-8665bbb447

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-273012-8665bbb447-4h8kx

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-273012

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-273012-8665bbb447 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-273012

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-273012-59dcd47f9f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk

Started

Container started
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-273012-59dcd47f9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-273012-59dcd47f9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-273012: serviceaccount "payload-processing-e2e-api-b-273012" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-94kvg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-94kvg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr

Created

Container created

openshift-ingress

multus

payload-processing-e2e-api-b-273012-8665bbb447-4h8kx

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-273012-8665bbb447-4h8kx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-273012-8665bbb447-4h8kx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-273012-8665bbb447-4h8kx

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-552v8

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ab592834-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-mt-ab592834-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ab592834-openshift-default-7f97f8769 from 4 to 8

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

AddedInterface

Add eth0 [10.133.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

ProbeError

Startup probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

ProbeError

Startup probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

Unhealthy

Startup probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

Unhealthy

Startup probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Unhealthy

Readiness probe failed: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

ProbeError

Readiness probe error: Get "http://10.133.0.118:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-ab592834-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": read tcp 10.134.0.2:60696->10.134.0.83:15021: read: connection reset by peer

openshift-ingress

deployment-controller

e2e-mt-ab592834-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ab592834-openshift-default-7f97f8769 from 8 to 10

openshift-ingress

multus

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

AddedInterface

Add eth0 [10.132.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

(combined from similar events): Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": read tcp 10.134.0.2:60696->10.134.0.83:15021: read: connection reset by peer body:

openshift-ingress

replicaset-controller

e2e-mt-ab592834-openshift-default-7f97f8769

SuccessfulCreate

Created pod: e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7d8392-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-7d8392-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-api-b-642fe5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-642fe5-openshift-default-76fb996475 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-642fe5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-642fe5

openshift-ingress

replicaset-controller

e2e-api-b-642fe5-openshift-default-76fb996475

SuccessfulCreate

Created pod: e2e-api-b-642fe5-openshift-default-76fb996475-967bc

openshift-ingress

multus

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

AddedInterface

Add eth0 [10.133.0.126/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

ProbeError

Startup probe error: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Unhealthy

Startup probe failed: Get "http://10.133.0.118:15021/healthz/ready": dial tcp 10.133.0.118:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

ProbeError

Startup probe error: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

Unhealthy

Startup probe failed: Get "http://10.132.0.107:15021/healthz/ready": dial tcp 10.132.0.107:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-141053-6f49fbc9bc-vzzm2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-141053-6db8f5499f-vr6jk

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-151744-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-151744-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a917b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a917b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-642fe5-dd986566f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-642fe5: serviceaccount "payload-processing-e2e-api-b-642fe5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-642fe5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-642fe5-dd986566f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-642fe5-dd986566f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-642fe5-dd986566f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-642fe5: serviceaccount "payload-processing-e2e-api-b-642fe5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-642fe5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-151744-7bd85db9f5-gqmh6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-151744-5964df88ff-mf88l

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-151744-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-151744-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

multus

test-curl-7603-2f99f8

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7603-2f99f8

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
(x2)

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-141053-openshift-default-6694f679f7-2vzmm

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7603-2f99f8

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 4.523s (4.523s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7603-2f99f8

Started

Container started

opendatahub

kubelet

test-curl-7603-2f99f8

Created

Container created

opendatahub

kubelet

test-curl-7603-2f99f8

Killing

Stopping container test-curl-7603-2f99f8
(x5)

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-a917b1-87b985f47-4kdl5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a917b1-869f8fb44c-4ntmg

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a917b1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-a917b1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

Started

Container started

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-api-a-151744-openshift-default-68fc44b48f-dnvwm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-273012-8665bbb447-4h8kx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-273012-59dcd47f9f-28whr

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

ProbeError

Startup probe error: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-b-a917b1-openshift-default-7bb7654c89-dqlhw

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

Unhealthy

Startup probe failed: Get "http://10.133.0.126:15021/healthz/ready": dial tcp 10.133.0.126:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d8392-fd6bdf685-cxsnk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d8392-c5d8585cf-kd56t

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-642fe5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-642fe5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-273012-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-273012-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-gpt97

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-t454h

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-7d8392-openshift-default-7cf6f4f76c-wxcj6

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ab592834-7b89945cbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ab592834-7b89945cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ab592834: serviceaccount "payload-processing-e2e-mt-ab592834" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ab592834-6f7b8f6bc5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ab592834-6f7b8f6bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ab592834: serviceaccount "payload-processing-e2e-mt-ab592834" not found

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ab592834-6f7b8f6bc5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-642fe5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ab592834

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ab592834-7b89945cbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ab592834-7b89945cbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-642fe5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ab592834

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ab592834-6f7b8f6bc5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-90bad4-openshift-default-7b77796d5c

SuccessfulCreate

Created pod: e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

openshift-ingress

gateway_labeler_controller

e2e-api-a-90bad4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-90bad4

openshift-ingress

deployment-controller

e2e-api-a-90bad4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-90bad4-openshift-default-7b77796d5c from 0 to 1

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-273012-openshift-default-696fb5cfbf-nxk92

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-90bad4-5f94bdb77f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-90bad4: serviceaccount "payload-processing-e2e-api-a-90bad4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-90bad4-5f94bdb77f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-90bad4-5f94bdb77f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-90bad4: serviceaccount "payload-processing-e2e-api-a-90bad4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-90bad4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-90bad4-5f94bdb77f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-90bad4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-90bad4-56b44f59d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582

Created

Container created

openshift-ingress

deployment-controller

e2e-ipp-a-a51d55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a51d55-openshift-default-685585d7df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a51d55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a51d55

openshift-ingress

replicaset-controller

e2e-ipp-a-a51d55-openshift-default-685585d7df

SuccessfulCreate

Created pod: e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

openshift-ingress

multus

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-642fe5-dd986566f-m6bd6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-642fe5-6bb9668fc9-4dc6f

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a51d55: serviceaccount "payload-processing-e2e-ipp-a-a51d55" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a51d55-cb498f7d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a51d55-cb498f7d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a51d55-cb498f7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a51d55: serviceaccount "payload-processing-e2e-ipp-a-a51d55" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a51d55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a51d55-d9996b99 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a51d55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a51d55-cb498f7d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7603-64cfdb

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7603-64cfdb

Created

Container created

opendatahub

kubelet

test-curl-7603-64cfdb

Started

Container started

opendatahub

kubelet

test-curl-7603-64cfdb

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7603-64cfdb

Killing

Stopping container test-curl-7603-64cfdb

openshift-ingress

replicaset-controller

e2e-api-b-38c9b0-openshift-default-778969b477

SuccessfulCreate

Created pod: e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

openshift-ingress

deployment-controller

e2e-api-b-38c9b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-38c9b0-openshift-default-778969b477 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-38c9b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-38c9b0

openshift-ingress

multus

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-38c9b0-7dffb748cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-38c9b0-7dffb748cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-38c9b0: serviceaccount "payload-processing-e2e-api-b-38c9b0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-38c9b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-38c9b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-38c9b0-7dffb748cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-38c9b0-7dffb748cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-38c9b0: serviceaccount "payload-processing-e2e-api-b-38c9b0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj

AddedInterface

Add eth0 [10.132.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-ab592834-6f7b8f6bc5-qswwg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ab592834-7b89945cbc-fwktn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-cb498f7d7-ppmlj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-642fe5-openshift-default-76fb996475-967bc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc

SuccessfulCreate

Created pod: e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-de30a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-de30a0

openshift-ingress

deployment-controller

e2e-ipp-a-de30a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-de30a0-openshift-default-7845bcdbfc from 0 to 1

openshift-ingress

multus

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

AddedInterface

Add eth0 [10.133.0.133/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a51d55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a51d55-7965b78fdd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-d9996b99-vct79

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.116:50052" within 1s: context deadline exceeded

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-4d9549

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-4d9549

openshift-ingress

replicaset-controller

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf

SuccessfulCreate

Created pod: e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

openshift-ingress

deployment-controller

e2e-ipp-a-4d9549-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a51d55: serviceaccount "payload-processing-e2e-ipp-a-a51d55" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a51d55-7965b78fdd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a51d55-7965b78fdd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a51d55-7965b78fdd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a51d55: serviceaccount "payload-processing-e2e-ipp-a-a51d55" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a51d55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.725s (1.725s including waiting). Image size: 166620835 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-de30a0-555947989f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-de30a0-555947989f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-de30a0: serviceaccount "payload-processing-e2e-ipp-a-de30a0" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.606s (1.606s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-de30a0: serviceaccount "payload-processing-e2e-ipp-a-de30a0" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-de30a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-de30a0-555947989f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-de30a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-de30a0-555947989f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd

Created

Container created

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

ProbeError

Readiness probe error: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq

Created

Container created

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

Unhealthy

Readiness probe failed: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-w8jg4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4d9549

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4d9549-797857cb67 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4d9549-797857cb67

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4d9549-797857cb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d9549: serviceaccount "payload-processing-e2e-ipp-a-4d9549" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d9549: serviceaccount "payload-processing-e2e-ipp-a-4d9549" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4d9549

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4d9549-797857cb67

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-w8jg4

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-w8jg4

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-w8jg4

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl

AddedInterface

Add eth0 [10.132.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-w8jg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-aa420c-openshift-default-575cf55575

SuccessfulCreate

Created pod: e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

openshift-ingress

deployment-controller

e2e-ipp-b-aa420c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-aa420c-openshift-default-575cf55575 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-aa420c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-aa420c

openshift-ingress

multus

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-774d9fb5ff-5vxjq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-555947989f-d77qd

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-38c9b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-aa420c-59dd6674d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-aa420c-59dd6674d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-aa420c-59dd6674d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-aa420c: serviceaccount "payload-processing-e2e-ipp-b-aa420c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-aa420c: serviceaccount "payload-processing-e2e-ipp-b-aa420c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-aa420c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-aa420c-59dd6674d5 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-38c9b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-aa420c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-90bad4-56b44f59d7-vl44k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-90bad4-5f94bdb77f-w6582

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a51d55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a51d55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-de30a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-de30a0-5c7f9478bd from 0 to 1
(x8)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-de30a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 6.398s (6.398s including waiting). Image size: 125353963 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-de30a0: serviceaccount "payload-processing-e2e-ipp-a-de30a0" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-de30a0: serviceaccount "payload-processing-e2e-ipp-a-de30a0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-38c9b0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-38c9b0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-de30a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-de30a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

Started

Container started

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-5bf4978c5-4sdbn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-797857cb67-7jprl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wjm9w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-552v8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a51d55-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a51d55-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-90bad4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-90bad4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d9549: serviceaccount "payload-processing-e2e-ipp-a-4d9549" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4d9549-689b88f9dd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4d9549-689b88f9dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4d9549: serviceaccount "payload-processing-e2e-ipp-a-4d9549" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4d9549

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4d9549-689b88f9dd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4d9549

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4d9549-99595fb75 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4d9549-689b88f9dd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5

Created

Container created

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-4j5n8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-8pk88

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-hprq7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-mnhwb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

Unhealthy

Readiness probe failed: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

ProbeError

Startup probe error: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

Unhealthy

Readiness probe failed: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-lrvgh

ProbeError

Readiness probe error: Get "http://10.133.0.124:15021/healthz/ready": dial tcp 10.133.0.124:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-p75w4

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-wvlbl

ProbeError

Readiness probe error: Get "http://10.132.0.105:15021/healthz/ready": dial tcp 10.132.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-ab592834-openshift-default-7f97f8769-rh242

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

Unhealthy

Startup probe failed: Get "http://10.133.0.133:15021/healthz/ready": dial tcp 10.133.0.133:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-a2697c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a2697c-openshift-default-785ff98597 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a2697c-openshift-default-785ff98597

SuccessfulCreate

Created pod: e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a2697c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a2697c

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-6cf854f859-rbvgd

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-90bad4-openshift-default-7b77796d5c-df9th

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.381s (3.381s including waiting). Image size: 166620835 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a2697c-f897bd975

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a2697c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a2697c: serviceaccount "payload-processing-e2e-ipp-b-a2697c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a2697c-f897bd975

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a2697c-f897bd975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a2697c: serviceaccount "payload-processing-e2e-ipp-b-a2697c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a2697c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a2697c-f897bd975 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-aa420c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-aa420c-5555c8f5d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-59dd6674d5-ng2mp

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.102:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-aa420c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-de30a0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-de30a0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-aa420c: serviceaccount "payload-processing-e2e-ipp-b-aa420c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-aa420c: serviceaccount "payload-processing-e2e-ipp-b-aa420c" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr

AddedInterface

Add eth0 [10.132.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-38c9b0-7974bd5d5f-bclmh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-38c9b0-7dffb748cf-j4wcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

Unhealthy

Readiness probe failed: Get "http://10.134.0.101:15021/healthz/ready": read tcp 10.134.0.2:50418->10.134.0.101:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

ProbeError

Readiness probe error: Get "http://10.134.0.101:15021/healthz/ready": read tcp 10.134.0.2:50418->10.134.0.101:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4d9549-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4d9549-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-814dc0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-814dc0

openshift-ingress

deployment-controller

e2e-ipp-b-814dc0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-814dc0-openshift-default-64bf5c84df from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-814dc0-openshift-default-64bf5c84df

SuccessfulCreate

Created pod: e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf
(x6)

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

AddedInterface

Add eth0 [10.134.0.109/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-814dc0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-814dc0-5f4f85df9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-814dc0: serviceaccount "payload-processing-e2e-ipp-b-814dc0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-814dc0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5 from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-aa420c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-aa420c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-814dc0: serviceaccount "payload-processing-e2e-ipp-b-814dc0" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-f897bd975-shvn5

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj

AddedInterface

Add eth0 [10.134.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-6f7df5f85f-wh5qd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a2697c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a2697c-777dbd5db8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a2697c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a2697c-777dbd5db8

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a2697c-777dbd5db8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a2697c: serviceaccount "payload-processing-e2e-ipp-b-a2697c" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a2697c-777dbd5db8

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t

openshift-ingress

multus

payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a2697c: serviceaccount "payload-processing-e2e-ipp-b-a2697c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-aa420c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-aa420c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-38c9b0-openshift-default-778969b477-d74m2

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4d9549-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-a-a51d55-openshift-default-685585d7df

SuccessfulCreate

Created pod: e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-a51d55-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-4d9549-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-6c7dc97fc5-b7rlj

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-a-a51d55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a51d55-openshift-default-685585d7df from 1 to 2

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-5f4f85df9f-4x7nl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-b3dc04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-b3dc04

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-b3dc04

openshift-ingress

replicaset-controller

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f

SuccessfulCreate

Created pod: e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

openshift-ingress

multus

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a2697c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a2697c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

Unhealthy

Startup probe failed: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

ProbeError

Startup probe error: Get "http://10.133.0.137:15021/healthz/ready": dial tcp 10.133.0.137:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-b3dc04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-b3dc04-668b4fd66c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-b3dc04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b3dc04: serviceaccount "payload-processing-e2e-praxis-a-b3dc04" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-b3dc04: serviceaccount "payload-processing-e2e-praxis-a-b3dc04" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-814dc0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-814dc0: serviceaccount "payload-processing-e2e-ipp-b-814dc0" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-814dc0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-814dc0-9648767d4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt

AddedInterface

Add eth0 [10.134.0.115/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-814dc0-9648767d4

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-814dc0-9648767d4

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-814dc0-9648767d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-814dc0: serviceaccount "payload-processing-e2e-ipp-b-814dc0" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h

AddedInterface

Add eth0 [10.134.0.118/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a2697c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

ProbeError

Readiness probe error: Get "http://10.134.0.109:15021/healthz/ready": read tcp 10.134.0.2:36276->10.134.0.109:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

Unhealthy

Readiness probe failed: Get "http://10.134.0.109:15021/healthz/ready": read tcp 10.134.0.2:36276->10.134.0.109:15021: read: connection reset by peer
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-a2697c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-de30a0-64dd64855f-s6gjw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-de30a0-5c7f9478bd-8sqls

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-wccjt

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-xd8tc

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 10 to 8
(x6)

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

Unhealthy

Startup probe failed: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

ProbeError

Startup probe error: Get "http://10.134.0.109:15021/healthz/ready": dial tcp 10.134.0.109:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-de30a0-openshift-default-7845bcdbfc-7hvgl

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-814dc0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-814dc0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a2697c-777dbd5db8-5jccs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a2697c-78f7fb465f-d845t

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-a-4d9549

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-a-4d9549: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-a-4d9549": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-a-4d9549, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8d34010f-7b0b-4de8-8a4e-b405c89ed73b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4d9549-99595fb75-4t7j5

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 10 to 8

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-f81a79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-f81a79

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4d9549-689b88f9dd-nvcmm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-b2mfj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-hmvw9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-b-f81a79-openshift-default-5669fdddb5

SuccessfulCreate

Created pod: e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

openshift-ingress

deployment-controller

e2e-praxis-b-f81a79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-f81a79-openshift-default-5669fdddb5 from 0 to 1

openshift-ingress

multus

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

AddedInterface

Add eth0 [10.133.0.142/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-814dc0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-814dc0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-a2697c-openshift-default-785ff98597-d6s6t

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3dc04-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-praxis-a-b3dc04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f

SuccessfulCreate

Created pod: e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

openshift-ingress

replicaset-controller

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f

SuccessfulCreate

Created pod: e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

openshift-ingress

replicaset-controller

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f

SuccessfulCreate

Created pod: e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

openshift-ingress

multus

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

Created

Container created

openshift-ingress

multus

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

AddedInterface

Add eth0 [10.133.0.143/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

Created

Container created

openshift-ingress

deployment-controller

e2e-praxis-a-835861-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-835861-openshift-default-54d5597d4f from 0 to 1

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-835861

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-835861

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-praxis-a-835861-openshift-default-54d5597d4f

SuccessfulCreate

Created pod: e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

openshift-ingress

multus

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

Started

Container started

openshift-ingress

kubelet

e2e-ipp-a-4d9549-openshift-default-6c4cfd6bf-m7njj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6nfm5

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-zrdsw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-835861: serviceaccount "payload-processing-e2e-praxis-a-835861" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-835861

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-835861-f6f9b8767 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-835861

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-835861-7dcf7b75f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-835861-7dcf7b75f7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-835861-7dcf7b75f7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-835861-7dcf7b75f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-835861: serviceaccount "payload-processing-e2e-praxis-a-835861" not found

openshift-ingress

multus

payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

ProbeError

Startup probe error: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

Unhealthy

Startup probe failed: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

ProbeError

Startup probe error: Get "http://10.133.0.143:15021/healthz/ready": dial tcp 10.133.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

Unhealthy

Startup probe failed: Get "http://10.132.0.140:15021/healthz/ready": dial tcp 10.132.0.140:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-dpmfr
(x7)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

ProbeError

Startup probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

Unhealthy

Startup probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 10 to 8

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-wx5tp

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x7)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

Unhealthy

Startup probe failed: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

ProbeError

Startup probe error: Get "http://10.134.0.119:15021/healthz/ready": dial tcp 10.134.0.119:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-f81a79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-f81a79-868ddc955 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-f81a79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-f81a79-57487c7bf7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f81a79-57487c7bf7

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-f81a79-57487c7bf7

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-f81a79-57487c7bf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f81a79: serviceaccount "payload-processing-e2e-praxis-b-f81a79" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-f81a79: serviceaccount "payload-processing-e2e-praxis-b-f81a79" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c

AddedInterface

Add eth0 [10.134.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3dc04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3dc04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

Unhealthy

Readiness probe failed: dial tcp 10.134.0.117:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-814dc0-5dcdd9d767-ctkf4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-814dc0-9648767d4-t979h

Unhealthy

Readiness probe failed: dial tcp 10.134.0.118:9004: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3dc04-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3dc04-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-b-814dc0-openshift-default-64bf5c84df-nkqlf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5

SuccessfulCreate

Created pod: e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

openshift-ingress

multus

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-cd6d01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-cd6d01

openshift-ingress

deployment-controller

e2e-praxis-a-cd6d01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-cd6d01-769f858f87

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-cd6d01-769f858f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-cd6d01: serviceaccount "payload-processing-e2e-praxis-a-cd6d01" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-cd6d01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-cd6d01: serviceaccount "payload-processing-e2e-praxis-a-cd6d01" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-cd6d01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-cd6d01-769f858f87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-cd6d01-769f858f87

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

AddedInterface

Add eth0 [10.134.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

Started

Container started

openshift-ingress

deployment-controller

e2e-praxis-b-08c392-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-08c392-openshift-default-768c847c6f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a51d55-7965b78fdd-t9jtm

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-praxis-b-08c392-openshift-default-768c847c6f

SuccessfulCreate

Created pod: e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-08c392

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-08c392

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a51d55-6458cc8bdc-xxn27

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-praxis-a-b3dc04-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-b3dc04-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

ProbeError

Readiness probe error: Get "http://10.133.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f

SuccessfulCreate

Created pod: e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

Unhealthy

Readiness probe failed: Get "http://10.133.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-08c392

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-08c392-79b8b7f779 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-08c392-79b8b7f779

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-08c392

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-08c392-6674df55cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-08c392-79b8b7f779

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-08c392-79b8b7f779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-08c392: serviceaccount "payload-processing-e2e-praxis-b-08c392" not found

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-08c392: serviceaccount "payload-processing-e2e-praxis-b-08c392" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

ProbeError

Readiness probe error: Get "http://10.133.0.144:15021/healthz/ready": read tcp 10.133.0.2:57216->10.133.0.144:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

Unhealthy

Readiness probe failed: Get "http://10.133.0.144:15021/healthz/ready": read tcp 10.133.0.2:57216->10.133.0.144:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-b3dc04-647565dcf9-lhk96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-b3dc04-668b4fd66c-x9nrt

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

ProbeError

Startup probe error: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

Unhealthy

Startup probe failed: Get "http://10.133.0.142:15021/healthz/ready": dial tcp 10.133.0.142:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-praxis-b-a35a97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-a35a97-openshift-default-5cbc948f7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-a35a97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-a35a97

openshift-ingress

replicaset-controller

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c

SuccessfulCreate

Created pod: e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

openshift-ingress

multus

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-835861-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-835861-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-jmnfx

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a35a97: serviceaccount "payload-processing-e2e-praxis-b-a35a97" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-a35a97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-a35a97-5bd6769d89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a35a97-5bd6769d89

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-a35a97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a35a97-5bd6769d89

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-a35a97-5bd6769d89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a35a97: serviceaccount "payload-processing-e2e-praxis-b-a35a97" not found

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx

AddedInterface

Add eth0 [10.134.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx

Started

Container started

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-vh2rm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-6j8vd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

ProbeError

Readiness probe error: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-f4jlm

Unhealthy

Readiness probe failed: Get "http://10.134.0.114:15021/healthz/ready": dial tcp 10.134.0.114:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-b3dc04-openshift-default-78ddc9b56f-4fkkl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f81a79-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-f81a79-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

ProbeError

Readiness probe error: Get "http://10.133.0.148:15021/healthz/ready": read tcp 10.133.0.2:51356->10.133.0.148:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

Unhealthy

Readiness probe failed: Get "http://10.133.0.148:15021/healthz/ready": read tcp 10.133.0.2:51356->10.133.0.148:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-835861-f6f9b8767-pz4xc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-835861-7dcf7b75f7-knv9p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-f81a79-57487c7bf7-wb66c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-f81a79-868ddc955-mwscr

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

Unhealthy

Startup probe failed: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

ProbeError

Startup probe error: Get "http://10.133.0.148:15021/healthz/ready": dial tcp 10.133.0.148:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-08c392-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-08c392-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-835861-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-835861-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-8jzxr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-835861-openshift-default-54d5597d4f-958p7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-a51d55-openshift-default-685585d7df-9w44t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-b-f81a79-openshift-default-5669fdddb5-rcqpb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-08c392-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-08c392-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-08c392-79b8b7f779-zcqh8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a35a97-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a35a97-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-ipp-a-18264e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-18264e-openshift-default-69d4b49699 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

ProbeError

Startup probe error: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

Unhealthy

Startup probe failed: Get "http://10.134.0.128:15021/healthz/ready": dial tcp 10.134.0.128:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-18264e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-18264e

openshift-ingress

replicaset-controller

e2e-ipp-a-18264e-openshift-default-69d4b49699

SuccessfulCreate

Created pod: e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

openshift-ingress

multus

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-08c392-6674df55cf-88tj6

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.127:50052" within 1s: context deadline exceeded

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-18264e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-18264e-7d45bb8b6f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-18264e: serviceaccount "payload-processing-e2e-ipp-a-18264e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-18264e: serviceaccount "payload-processing-e2e-ipp-a-18264e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-18264e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9

openshift-ingress

kubelet

e2e-praxis-b-08c392-openshift-default-768c847c6f-tczrh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-aa420c-bbd7c4b4c-sn4wr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-aa420c-5555c8f5d6-wnknh

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-ipp-b-aa420c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ipp-b-aa420c: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ipp-b-aa420c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ipp-b-aa420c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 56fa8c9c-8a88-420d-bb85-ea4a56bf0720, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-aa420c-openshift-default-575cf55575-5zsft

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-35afa6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-35afa6

openshift-ingress

deployment-controller

e2e-praxis-a-35afa6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-35afa6-openshift-default-6c47ff9c57 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57

SuccessfulCreate

Created pod: e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

openshift-ingress

multus

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-65b8fb9867-bgwxv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-7d45bb8b6f-cnlm9

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-35afa6: serviceaccount "payload-processing-e2e-praxis-a-35afa6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-35afa6-75479676bc

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-35afa6-75479676bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-35afa6: serviceaccount "payload-processing-e2e-praxis-a-35afa6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-35afa6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-35afa6-75479676bc from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a35a97-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a35a97-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-35afa6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b

AddedInterface

Add eth0 [10.133.0.158/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6

AddedInterface

Add eth0 [10.134.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-35afa6-75479676bc

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-18264e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-18264e-5554bd494b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-18264e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-18264e: serviceaccount "payload-processing-e2e-ipp-a-18264e" not found
(x2)

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-18264e-5554bd494b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-18264e-5554bd494b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-18264e: serviceaccount "payload-processing-e2e-ipp-a-18264e" not found

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2

AddedInterface

Add eth0 [10.134.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-18264e-5554bd494b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

ProbeError

Startup probe error: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

Unhealthy

Startup probe failed: Get "http://10.134.0.124:15021/healthz/ready": dial tcp 10.134.0.124:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 8 to 10
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

AddedInterface

Add eth0 [10.133.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

Created

Container created

openshift-ingress

multus

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

AddedInterface

Add eth0 [10.133.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

ProbeError

Startup probe error: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

Unhealthy

Startup probe failed: Get "http://10.133.0.160:15021/healthz/ready": dial tcp 10.133.0.160:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

Unhealthy

Startup probe failed: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

ProbeError

Startup probe error: Get "http://10.133.0.159:15021/healthz/ready": dial tcp 10.133.0.159:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cd6d01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-ipp-b-8bbb6e-openshift-default-669db9d899

SuccessfulCreate

Created pod: e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

openshift-ingress

deployment-controller

e2e-ipp-b-8bbb6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8bbb6e-openshift-default-669db9d899 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8bbb6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8bbb6e
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cd6d01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-praxis-b-343e30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-343e30-openshift-default-6ffd77848f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-343e30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-343e30

openshift-ingress

replicaset-controller

e2e-praxis-b-343e30-openshift-default-6ffd77848f

SuccessfulCreate

Created pod: e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

openshift-ingress

multus

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

Unhealthy

Readiness probe failed: Get "http://10.134.0.132:15021/healthz/ready": read tcp 10.134.0.2:34078->10.134.0.132:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

ProbeError

Readiness probe error: Get "http://10.134.0.132:15021/healthz/ready": read tcp 10.134.0.2:34078->10.134.0.132:15021: read: connection reset by peer body:

openshift-ingress

multus

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w0-f78621-openshift-default-74d8d5d569

SuccessfulDelete

Deleted pod: e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-5c5zn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w0-f78621-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f78621-openshift-default-74d8d5d569 from 4 to 3
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8bbb6e: serviceaccount "payload-processing-e2e-ipp-b-8bbb6e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8bbb6e-798b84b989

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8bbb6e-798b84b989

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8bbb6e-798b84b989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8bbb6e: serviceaccount "payload-processing-e2e-ipp-b-8bbb6e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8bbb6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8bbb6e-798b84b989 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8bbb6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg

AddedInterface

Add eth0 [10.133.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 8 to 7

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zb6jz
(x5)

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-18264e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-18264e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cd6d01-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-cd6d01-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-343e30-56d96cd497

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-343e30-56d96cd497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-343e30: serviceaccount "payload-processing-e2e-praxis-b-343e30" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-343e30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-343e30-56d96cd497 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-343e30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-343e30: serviceaccount "payload-processing-e2e-praxis-b-343e30" not found
(x3)

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-343e30-56d96cd497

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 8 to 7
(x2)

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 8 to 10

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-gkh72

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

AddedInterface

Add eth0 [10.133.0.164/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

Unhealthy

Startup probe failed: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

ProbeError

Startup probe error: Get "http://10.133.0.164:15021/healthz/ready": dial tcp 10.133.0.164:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Unhealthy

Readiness probe failed: Get "http://10.134.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

ProbeError

Readiness probe error: Get "http://10.134.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-18264e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-18264e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-798b84b989-4bhzg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-7b7f9c44d7-8mkzx

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8bbb6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8bbb6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8bbb6e-779859794 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8bbb6e-779859794

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8bbb6e-779859794

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8bbb6e-779859794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8bbb6e: serviceaccount "payload-processing-e2e-ipp-b-8bbb6e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8bbb6e: serviceaccount "payload-processing-e2e-ipp-b-8bbb6e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6

Started

Container started

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-94kvg

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-94kvg

Killing

Stopping container discovery

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

Unhealthy

Readiness probe failed: Get "http://10.134.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

ProbeError

Readiness probe error: Get "http://10.134.0.140:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-35afa6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Unhealthy

Readiness probe failed: Get "http://10.134.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-35afa6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

ProbeError

Readiness probe error: Get "http://10.134.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-35afa6-6b9f65cc9-6bk9b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-35afa6-75479676bc-sp6v6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

ProbeError

Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

Unhealthy

Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8bbb6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8bbb6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

Unhealthy

Readiness probe failed: Get "http://10.133.0.160:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-343e30-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-343e30-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

Unhealthy

Readiness probe failed: Get "http://10.133.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

ProbeError

Readiness probe error: Get "http://10.133.0.160:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

ProbeError

Readiness probe error: Get "http://10.133.0.159:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-a-35afa6-openshift-default-6c47ff9c57-z87gx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-55gz5

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-343e30-56d96cd497-6rxxc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-343e30-75cdc6b68c-nxxn7

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-343e30-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-343e30-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-18264e-64dc9f8f47-j7mf2

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 7 to 6

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-18264e-5554bd494b-mdvqg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-n9mq2

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-cd6d01-778dc7f855-dgvb6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-cd6d01-769f858f87-x4psz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-ipp-a-18264e-openshift-default-69d4b49699-7hrmv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-praxis-b-343e30-openshift-default-6ffd77848f-4bxxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8bbb6e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-8bbb6e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8bbb6e-779859794-72jv6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8bbb6e-5fb9f876f5-gj6f6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8bbb6e-openshift-default-669db9d899-5mggq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f

SuccessfulCreate

Created pod: e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-8g4cp

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-e92a08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-e92a08

openshift-ingress

deployment-controller

e2e-shared-a-w4-e92a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-e92a08-openshift-default-7694cb68f from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 6 to 5

openshift-ingress

multus

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

AddedInterface

Add eth0 [10.133.0.178/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-e92a08: serviceaccount "payload-processing-e2e-shared-a-w4-e92a08" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-e92a08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-e92a08-cb5756c95 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-e92a08: serviceaccount "payload-processing-e2e-shared-a-w4-e92a08" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-e92a08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

AddedInterface

Add eth0 [10.134.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-6012b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-6012b5

openshift-ingress

replicaset-controller

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c

SuccessfulCreate

Created pod: e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

openshift-ingress

deployment-controller

e2e-shared-a-w1-6012b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

AddedInterface

Add eth0 [10.134.0.151/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-6012b5: serviceaccount "payload-processing-e2e-shared-a-w1-6012b5" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-6012b5: serviceaccount "payload-processing-e2e-shared-a-w1-6012b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-6012b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-6012b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

AddedInterface

Add eth0 [10.132.0.156/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

AddedInterface

Add eth0 [10.133.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-zw9xg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-fcc2ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-fcc2ce

openshift-ingress

replicaset-controller

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7

SuccessfulCreate

Created pod: e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

openshift-ingress

deployment-controller

e2e-shared-b-w4-fcc2ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

Unhealthy

Readiness probe failed: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

ProbeError

Readiness probe error: Get "http://10.132.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

ProbeError

Readiness probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

Unhealthy

Readiness probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

AddedInterface

Add eth0 [10.133.0.183/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df

SuccessfulCreate

Created pod: e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-47a8a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-47a8a4

openshift-ingress

deployment-controller

e2e-shared-a-w2-47a8a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

AddedInterface

Add eth0 [10.133.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-cd6d01-openshift-default-85bbcffdd5-pglvd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

ProbeError

Readiness probe error: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

AddedInterface

Add eth0 [10.133.0.185/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

Unhealthy

Readiness probe failed: Get "http://10.133.0.178:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-fcc2ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-fcc2ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-fcc2ce-694c767579 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-fcc2ce: serviceaccount "payload-processing-e2e-shared-b-w4-fcc2ce" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-fcc2ce: serviceaccount "payload-processing-e2e-shared-b-w4-fcc2ce" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t

AddedInterface

Add eth0 [10.134.0.152/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-cc8214

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-cc8214

openshift-ingress

replicaset-controller

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c

SuccessfulCreate

Created pod: e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

openshift-ingress

deployment-controller

e2e-shared-b-w1-cc8214-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

AddedInterface

Add eth0 [10.134.0.153/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-cc8214: serviceaccount "payload-processing-e2e-shared-b-w1-cc8214" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-cc8214

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-6012b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-cc8214: serviceaccount "payload-processing-e2e-shared-b-w1-cc8214" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-6012b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-cc8214

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467 from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-fcc2ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-fcc2ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

AddedInterface

Add eth0 [10.134.0.154/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v

AddedInterface

Add eth0 [10.133.0.188/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a35a97-6bff94d6bc-smzl8

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

ProbeError

Startup probe error: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a35a97-5bd6769d89-k5lzx

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

Unhealthy

Startup probe failed: Get "http://10.133.0.178:15021/healthz/ready": dial tcp 10.133.0.178:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-e92a08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-e92a08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-47a8a4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-47a8a4: serviceaccount "payload-processing-e2e-shared-a-w2-47a8a4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-47a8a4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-47a8a4: serviceaccount "payload-processing-e2e-shared-a-w2-47a8a4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

AddedInterface

Add eth0 [10.134.0.156/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797

SuccessfulCreate

Created pod: e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-ce5555

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-ce5555

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

openshift-ingress

deployment-controller

e2e-shared-a-w3-ce5555-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulCreate

Created pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

AddedInterface

Add eth0 [10.133.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

AddedInterface

Add eth0 [10.134.0.158/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

AddedInterface

Add eth0 [10.134.0.159/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

AddedInterface

Add eth0 [10.133.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

Started

Container started

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

AddedInterface

Add eth0 [10.134.0.157/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ce5555: serviceaccount "payload-processing-e2e-shared-a-w3-ce5555" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-ce5555

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-ce5555-76c84548c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

ProbeError

Startup probe error: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-ce5555

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

Unhealthy

Startup probe failed: Get "http://10.133.0.189:15021/healthz/ready": dial tcp 10.133.0.189:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ce5555: serviceaccount "payload-processing-e2e-shared-a-w3-ce5555" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

Unhealthy

Startup probe failed: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

ProbeError

Startup probe error: Get "http://10.133.0.190:15021/healthz/ready": dial tcp 10.133.0.190:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

Unhealthy

Startup probe failed: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

Unhealthy

Startup probe failed: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

ProbeError

Startup probe error: Get "http://10.134.0.157:15021/healthz/ready": dial tcp 10.134.0.157:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

ProbeError

Startup probe error: Get "http://10.134.0.158:15021/healthz/ready": dial tcp 10.134.0.158:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

Unhealthy

Readiness probe failed: Get "http://10.134.0.151:15021/healthz/ready": read tcp 10.134.0.2:55670->10.134.0.151:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

ProbeError

Readiness probe error: Get "http://10.134.0.151:15021/healthz/ready": read tcp 10.134.0.2:55670->10.134.0.151:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-a35a97-openshift-default-5cbc948f7c-pr99f

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

Unhealthy

Startup probe failed: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

ProbeError

Startup probe error: Get "http://10.134.0.151:15021/healthz/ready": dial tcp 10.134.0.151:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-e92a08-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-e92a08-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

Unhealthy

Readiness probe failed: Get "http://10.133.0.183:15021/healthz/ready": read tcp 10.133.0.2:50712->10.133.0.183:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

ProbeError

Readiness probe error: Get "http://10.133.0.183:15021/healthz/ready": read tcp 10.133.0.2:50712->10.133.0.183:15021: read: connection reset by peer body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-e11de4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-e11de4

openshift-ingress

multus

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-explicit-3ba121

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-3ba121

openshift-ingress

replicaset-controller

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65

SuccessfulCreate

Created pod: e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

openshift-ingress

deployment-controller

e2e-shared-b-w2-e11de4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

Created

Container created

openshift-ingress

replicaset-controller

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf

SuccessfulCreate

Created pod: e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

openshift-ingress

multus

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-3ba121-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-3ba121-openshift-default-5dcf7fbcbf from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-cc8214-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-cc8214-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-b-w3-836589-openshift-default-54b68dc845

SuccessfulCreate

Created pod: e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-836589

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-836589

openshift-ingress

deployment-controller

e2e-shared-b-w3-836589-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-836589-openshift-default-54b68dc845 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-e11de4: serviceaccount "payload-processing-e2e-shared-b-w2-e11de4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-e11de4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-e11de4: serviceaccount "payload-processing-e2e-shared-b-w2-e11de4" not found

openshift-ingress

multus

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-e11de4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-e11de4-549d7f476c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

AddedInterface

Add eth0 [10.133.0.196/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-3ba121: serviceaccount "payload-processing-e2e-explicit-3ba121" not found
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

Unhealthy

Startup probe failed: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

ProbeError

Startup probe error: Get "http://10.133.0.183:15021/healthz/ready": dial tcp 10.133.0.183:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-3ba121

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-3ba121

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-3ba121-6b4d4b46df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-3ba121-6b4d4b46df

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-3ba121-6b4d4b46df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-3ba121: serviceaccount "payload-processing-e2e-explicit-3ba121" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-3ba121-6b4d4b46df

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

Created

Container created

openshift-ingress

multus

payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

Unhealthy

Startup probe failed: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

ProbeError

Startup probe error: Get "http://10.134.0.153:15021/healthz/ready": dial tcp 10.134.0.153:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-836589

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-836589-7589f8657f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-836589-7589f8657f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-836589: serviceaccount "payload-processing-e2e-shared-b-w3-836589" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-836589: serviceaccount "payload-processing-e2e-shared-b-w3-836589" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-836589

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-836589-7589f8657f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-836589-7589f8657f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

AddedInterface

Add eth0 [10.133.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-fcc2ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-6012b5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-fcc2ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-6012b5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-4s98l

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-4s98l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 10 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-7h7sb

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7h7sb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

ProbeError

Startup probe error: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

Unhealthy

Startup probe failed: Get "http://10.133.0.184:15021/healthz/ready": dial tcp 10.133.0.184:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-cc8214-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-cc8214-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-836589-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-836589-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

Unhealthy

Startup probe failed: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

ProbeError

Startup probe error: Get "http://10.134.0.159:15021/healthz/ready": dial tcp 10.134.0.159:15021: connect: connection refused body:
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

ProbeError

Readiness probe error: Get "http://10.134.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

Unhealthy

Readiness probe failed: Get "http://10.134.0.162:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-e11de4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-e11de4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-3ba121-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

ProbeError

Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

Unhealthy

Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-3ba121-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3ba121-7bc9c97f9-84pq8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-3ba121-6b4d4b46df-8rfwm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ce5555-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ce5555-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-e11de4-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-e11de4-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-noten-b5a832-openshift-default-5b7797f6f5

SuccessfulCreate

Created pod: e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

openshift-ingress

deployment-controller

e2e-noten-b5a832-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-b5a832-openshift-default-5b7797f6f5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-b5a832

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-b5a832

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-3ba121-openshift-default-5dcf7fbcbf-dtmgl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

Started

Container started

openshift-ingress

kubelet

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

Created

Container created

openshift-ingress

kubelet

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-836589-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-836589-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-shared-b-w2-e11de4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-e11de4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65

SuccessfulCreate

Created pod: e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

openshift-ingress

kubelet

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

AddedInterface

Add eth0 [10.133.0.203/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

Started

Container started

openshift-ingress

kubelet

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-b5a832-openshift-default-5b7797f6f5-7rgwt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

Unhealthy

Startup probe failed: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

ProbeError

Startup probe error: Get "http://10.133.0.203:15021/healthz/ready": dial tcp 10.133.0.203:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-47a8a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df

SuccessfulCreate

Created pod: e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

AddedInterface

Add eth0 [10.134.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

Started

Container started

opendatahub

multus

test-curl-7600-2136b0

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7600-2136b0

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

opendatahub

kubelet

test-curl-7600-2136b0

Started

Container started

opendatahub

kubelet

test-curl-7600-2136b0

Created

Container created

opendatahub

kubelet

test-curl-7600-2136b0

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 1.101s (1.101s including waiting). Image size: 106100986 bytes.

opendatahub

kubelet

test-curl-7600-9feb67

Started

Container started

opendatahub

kubelet

test-curl-7600-9feb67

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7600-2136b0

Killing

Stopping container test-curl-7600-2136b0
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

Unhealthy

Startup probe failed: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

ProbeError

Startup probe error: Get "http://10.134.0.169:15021/healthz/ready": dial tcp 10.134.0.169:15021: connect: connection refused body:

opendatahub

multus

test-curl-7600-9feb67

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7600-9feb67

Created

Container created

opendatahub

kubelet

test-curl-7600-9feb67

Killing

Stopping container test-curl-7600-9feb67

openshift-ingress

replicaset-controller

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f

SuccessfulCreate

Created pod: e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

openshift-ingress

deployment-controller

e2e-shared-a-w0-9c53b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-9c53b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-9c53b2

openshift-ingress

multus

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-9c53b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-9c53b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-9c53b2: serviceaccount "payload-processing-e2e-shared-a-w0-9c53b2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-9c53b2: serviceaccount "payload-processing-e2e-shared-a-w0-9c53b2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

AddedInterface

Add eth0 [10.133.0.205/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-qm5hv

openshift-ingress

deployment-controller

e2e-shared-a-w4-e92a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-e92a08-openshift-default-7694cb68f from 1 to 2

openshift-ingress

multus

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

AddedInterface

Add eth0 [10.134.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-e92a08-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f

SuccessfulCreate

Created pod: e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

ProbeError

Startup probe error: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

Unhealthy

Startup probe failed: Get "http://10.134.0.170:15021/healthz/ready": dial tcp 10.134.0.170:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5

SuccessfulCreate

Created pod: e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-ef1662

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-ef1662

openshift-ingress

deployment-controller

e2e-shared-b-w0-ef1662-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-ef1662

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-ef1662: serviceaccount "payload-processing-e2e-shared-b-w0-ef1662" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-ef1662: serviceaccount "payload-processing-e2e-shared-b-w0-ef1662" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-ef1662

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

AddedInterface

Add eth0 [10.133.0.208/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt

AddedInterface

Add eth0 [10.133.0.209/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

Unhealthy

Readiness probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

ProbeError

Readiness probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

ProbeError

Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

Unhealthy

Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-9c53b2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-9c53b2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7600-7b8f81

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7600-7b8f81

AddedInterface

Add eth0 [10.132.0.173/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7600-7b8f81

Started

Container started

opendatahub

kubelet

test-curl-7600-7b8f81

Created

Container created

opendatahub

kubelet

test-curl-7600-1f367c

Started

Container started

opendatahub

kubelet

test-curl-7600-7b8f81

Killing

Stopping container test-curl-7600-7b8f81

opendatahub

kubelet

test-curl-7600-1f367c

Created

Container created

opendatahub

kubelet

test-curl-7600-1f367c

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7600-1f367c

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7600-53c342

Created

Container created

opendatahub

kubelet

test-curl-7600-53c342

Started

Container started

opendatahub

kubelet

test-curl-7600-53c342

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7600-1f367c

Killing

Stopping container test-curl-7600-1f367c

opendatahub

multus

test-curl-7600-53c342

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

opendatahub

multus

test-curl-7600-b41f69

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7600-b41f69

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7600-53c342

Killing

Stopping container test-curl-7600-53c342

opendatahub

kubelet

test-curl-7600-b41f69

Started

Container started

opendatahub

kubelet

test-curl-7600-b41f69

Created

Container created

opendatahub

kubelet

test-curl-7600-b41f69

Killing

Stopping container test-curl-7600-b41f69

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-185908

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-185908

openshift-ingress

replicaset-controller

e2e-extmod-a-185908-openshift-default-795bb9d77

SuccessfulCreate

Created pod: e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

openshift-ingress

deployment-controller

e2e-extmod-a-185908-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-185908-openshift-default-795bb9d77 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-9c53b2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-9c53b2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-185908

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-185908

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-185908-5f495fdb69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-185908-5f495fdb69

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-185908-5f495fdb69

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-185908-5f495fdb69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-185908: serviceaccount "payload-processing-e2e-extmod-a-185908" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-185908: serviceaccount "payload-processing-e2e-extmod-a-185908" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns

AddedInterface

Add eth0 [10.134.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp

AddedInterface

Add eth0 [10.133.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Unhealthy

Readiness probe failed: Get "http://10.133.0.207:15021/healthz/ready": read tcp 10.133.0.2:44912->10.133.0.207:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

ProbeError

Readiness probe error: Get "http://10.133.0.207:15021/healthz/ready": read tcp 10.133.0.2:44912->10.133.0.207:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df

SuccessfulCreate

Created pod: e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

openshift-ingress

deployment-controller

e2e-shared-a-w2-47a8a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df from 2 to 3

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

Created

Container created

openshift-ingress

multus

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Unhealthy

Startup probe failed: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

ProbeError

Startup probe error: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-185908-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-917da2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-917da2

openshift-ingress

replicaset-controller

e2e-extmod-a-917da2-openshift-default-578f45548f

SuccessfulCreate

Created pod: e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

openshift-ingress

deployment-controller

e2e-extmod-a-917da2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-917da2-openshift-default-578f45548f from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-185908-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-56687c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-56687c-openshift-default-5d54886fb9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-56687c-openshift-default-5d54886fb9

SuccessfulCreate

Created pod: e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-56687c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-56687c

openshift-ingress

multus

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

AddedInterface

Add eth0 [10.134.0.182/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65

SuccessfulCreate

Created pod: e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-cbeebd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-cbeebd

openshift-ingress

deployment-controller

e2e-extmod-a-cbeebd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

AddedInterface

Add eth0 [10.134.0.183/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-ef1662-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-ef1662-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-917da2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-917da2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-917da2-5c9fcf7f59 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-917da2: serviceaccount "payload-processing-e2e-extmod-a-917da2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-917da2: serviceaccount "payload-processing-e2e-extmod-a-917da2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

openshift-ingress

multus

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

AddedInterface

Add eth0 [10.134.0.184/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-cbeebd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-cbeebd: serviceaccount "payload-processing-e2e-extmod-a-cbeebd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-cbeebd: serviceaccount "payload-processing-e2e-extmod-a-cbeebd" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-cbeebd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-cbeebd-66677c6dd9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

AddedInterface

Add eth0 [10.134.0.185/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs

AddedInterface

Add eth0 [10.133.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-56687c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-56687c-85989ddcb7

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-56687c-85989ddcb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-56687c: serviceaccount "payload-processing-e2e-extmod-b-56687c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-56687c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-56687c-85989ddcb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-56687c-85989ddcb7

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-56687c: serviceaccount "payload-processing-e2e-extmod-b-56687c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

AddedInterface

Add eth0 [10.134.0.187/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws

AddedInterface

Add eth0 [10.134.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-fb5766-openshift-default-79bb9d756f

SuccessfulCreate

Created pod: e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn
(x6)

openshift-ingress

kubelet

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

Unhealthy

Startup probe failed: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-fb5766-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fb5766-openshift-default-79bb9d756f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-fb5766

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-fb5766
(x6)

openshift-ingress

kubelet

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

ProbeError

Startup probe error: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

AddedInterface

Add eth0 [10.133.0.225/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-c5p2r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-8x9nk

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-ms8hx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-fb5766

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-fb5766-fdd496649 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-fb5766

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fb5766-fdd496649

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-fb5766-fdd496649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fb5766: serviceaccount "payload-processing-e2e-extmod-b-fb5766" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-fb5766: serviceaccount "payload-processing-e2e-extmod-b-fb5766" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-fb5766-fdd496649

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh

AddedInterface

Add eth0 [10.134.0.189/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

AddedInterface

Add eth0 [10.134.0.188/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-b76c62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-b76c62

openshift-ingress

deployment-controller

e2e-extmod-b-b76c62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b76c62-openshift-default-7f44764669 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-b76c62-openshift-default-7f44764669

SuccessfulCreate

Created pod: e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

openshift-ingress

multus

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

AddedInterface

Add eth0 [10.134.0.190/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-b76c62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-b76c62-69b644f695 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b76c62: serviceaccount "payload-processing-e2e-extmod-b-b76c62" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b76c62-65dc767945

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-b76c62-65dc767945

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-b76c62-65dc767945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-b76c62: serviceaccount "payload-processing-e2e-extmod-b-b76c62" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-b76c62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-b76c62-65dc767945 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg

AddedInterface

Add eth0 [10.134.0.191/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm

AddedInterface

Add eth0 [10.134.0.192/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-185908-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-185908-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b76c62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b76c62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

ProbeError

Readiness probe error: Get "http://10.133.0.222:15021/healthz/ready": read tcp 10.133.0.2:43712->10.133.0.222:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Unhealthy

Readiness probe failed: Get "http://10.133.0.222:15021/healthz/ready": read tcp 10.133.0.2:43712->10.133.0.222:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

ProbeError

Readiness probe error: Get "http://10.134.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

Unhealthy

Readiness probe failed: Get "http://10.134.0.182:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

Unhealthy

Readiness probe failed: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

ProbeError

Readiness probe error: Get "http://10.134.0.183:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fb5766-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fb5766-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Unhealthy

Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

ProbeError

Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

ProbeError

Startup probe error: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

Unhealthy

Startup probe failed: Get "http://10.134.0.182:15021/healthz/ready": dial tcp 10.134.0.182:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

Unhealthy

Startup probe failed: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

ProbeError

Startup probe error: Get "http://10.134.0.183:15021/healthz/ready": dial tcp 10.134.0.183:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-917da2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-917da2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-f78621-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cvlcw

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-cw94q

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w0-f78621-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-f78621-openshift-default-74d8d5d569 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w0-f78621-openshift-default-74d8d5d569

SuccessfulDelete

Deleted pod: e2e-worker-w0-f78621-openshift-default-74d8d5d569-88ppq

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-7zjjg

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cbeebd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cbeebd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56687c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56687c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

ProbeError

Readiness probe error: Get "http://10.134.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Unhealthy

Readiness probe failed: Get "http://10.134.0.190:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 8 to 7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-d7gsx

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-d7gsx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-a-9f53bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-9f53bb-openshift-default-567b58d445 from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-a-9f53bb-openshift-default-567b58d445

SuccessfulCreate

Created pod: e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-9f53bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-9f53bb

openshift-ingress

multus

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

ProbeError

Readiness probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-k8gdd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

Unhealthy

Readiness probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9f53bb: serviceaccount "payload-processing-e2e-extmod-a-9f53bb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-9f53bb: serviceaccount "payload-processing-e2e-extmod-a-9f53bb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-9f53bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-9f53bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-9f53bb-74c95f4db5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

AddedInterface

Add eth0 [10.134.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-dpls7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6csq7

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-wknz4
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-917da2-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-917da2-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

ProbeError

Startup probe error: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

Unhealthy

Startup probe failed: Get "http://10.133.0.225:15021/healthz/ready": dial tcp 10.133.0.225:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

ProbeError

Startup probe error: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Unhealthy

Startup probe failed: Get "http://10.134.0.190:15021/healthz/ready": dial tcp 10.134.0.190:15021: connect: connection refused

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-tfb77

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tfb77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

(combined from similar events): New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 4 to 3

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-s9l95
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b76c62-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b76c62-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kubelet

test-curl-7609-3410cd

Created

Container created

opendatahub

multus

test-curl-7609-3410cd

AddedInterface

Add eth0 [10.134.0.199/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7609-3410cd

Started

Container started

opendatahub

kubelet

test-curl-7609-3410cd

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7609-3410cd

Killing

Stopping container test-curl-7609-3410cd
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fb5766-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fb5766-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-d9f2ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-d9f2ce

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

AddedInterface

Add eth0 [10.134.0.200/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9f53bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9f53bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-autores-c8cb1f-openshift-default-58c8d48c7

SuccessfulCreate

Created pod: e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

openshift-ingress

gateway_labeler_controller

e2e-autores-c8cb1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-c8cb1f

openshift-ingress

deployment-controller

e2e-autores-c8cb1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-c8cb1f-openshift-default-58c8d48c7 from 0 to 1

openshift-ingress

multus

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

Unhealthy

Startup probe failed: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

ProbeError

Startup probe error: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-d9f2ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-d9f2ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d9f2ce: serviceaccount "payload-processing-e2e-extmod-b-d9f2ce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-d9f2ce: serviceaccount "payload-processing-e2e-extmod-b-d9f2ce" not found

openshift-ingress

multus

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f

AddedInterface

Add eth0 [10.133.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

AddedInterface

Add eth0 [10.134.0.201/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6

openshift-ingress

deployment-controller

payload-processing-e2e-autores-c8cb1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-c8cb1f-7b6fd79d99 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c8cb1f-7b6fd79d99

FailedCreate

Error creating: pods "payload-processing-e2e-autores-c8cb1f-7b6fd79d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c8cb1f: serviceaccount "payload-processing-e2e-autores-c8cb1f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c8cb1f: serviceaccount "payload-processing-e2e-autores-c8cb1f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c8cb1f-7b6fd79d99

SuccessfulCreate

Created pod: payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-c8cb1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2

AddedInterface

Add eth0 [10.134.0.204/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6

AddedInterface

Add eth0 [10.134.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6

Started

Container started
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9f53bb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9f53bb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c8cb1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c8cb1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

Created

Container created

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

AddedInterface

Add eth0 [10.134.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

Started

Container started

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

Unhealthy

Startup probe failed: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

ProbeError

Startup probe error: Get "http://10.132.0.185:15021/healthz/ready": dial tcp 10.132.0.185:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

ProbeError

Startup probe error: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

Unhealthy

Startup probe failed: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

Unhealthy

Startup probe failed: Get "http://10.134.0.207:15021/healthz/ready": dial tcp 10.134.0.207:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

ProbeError

Startup probe error: Get "http://10.134.0.207:15021/healthz/ready": dial tcp 10.134.0.207:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

ProbeError

Startup probe error: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

Unhealthy

Startup probe failed: Get "http://10.134.0.200:15021/healthz/ready": dial tcp 10.134.0.200:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-autores-c8cb1f-7b6fd79d99-dtdp2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c8cb1f-57bbcc4bff-6xwd6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c8cb1f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c8cb1f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulCreate

Created pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 4 to 8

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

AddedInterface

Add eth0 [10.132.0.186/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

Started

Container started

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

AddedInterface

Add eth0 [10.134.0.212/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

AddedInterface

Add eth0 [10.133.0.239/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-b76c62-openshift-default-7f44764669

SuccessfulCreate

Created pod: e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

openshift-ingress

deployment-controller

e2e-extmod-b-b76c62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-b76c62-openshift-default-7f44764669 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b76c62-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

AddedInterface

Add eth0 [10.133.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

ProbeError

Startup probe error: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

Unhealthy

Startup probe failed: Get "http://10.132.0.186:15021/healthz/ready": dial tcp 10.132.0.186:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

Unhealthy

Startup probe failed: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

ProbeError

Startup probe error: Get "http://10.134.0.212:15021/healthz/ready": dial tcp 10.134.0.212:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

Unhealthy

Startup probe failed: Get "http://10.133.0.239:15021/healthz/ready": dial tcp 10.133.0.239:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

Unhealthy

Startup probe failed: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

ProbeError

Startup probe error: Get "http://10.133.0.240:15021/healthz/ready": dial tcp 10.133.0.240:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

ProbeError

Startup probe error: Get "http://10.133.0.239:15021/healthz/ready": dial tcp 10.133.0.239:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-c8cb1f-openshift-default-58c8d48c7-hr2qj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45

SuccessfulCreate

Created pod: e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

openshift-ingress

deployment-controller

e2e-extmod-a-35936b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-35936b-openshift-default-5f7dd5fc45 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-35936b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-35936b
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

Unhealthy

Startup probe failed: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

AddedInterface

Add eth0 [10.134.0.213/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

ProbeError

Startup probe error: Get "http://10.133.0.241:15021/healthz/ready": dial tcp 10.133.0.241:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-35936b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-35936b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-35936b-555d5645bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-35936b: serviceaccount "payload-processing-e2e-extmod-a-35936b" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-35936b-555d5645bc

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-35936b-555d5645bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-35936b: serviceaccount "payload-processing-e2e-extmod-a-35936b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-35936b-555d5645bc

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q

AddedInterface

Add eth0 [10.134.0.215/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

AddedInterface

Add eth0 [10.134.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-5711cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-5711cf

openshift-ingress

replicaset-controller

e2e-extmod-b-5711cf-openshift-default-7f5d5f45

SuccessfulCreate

Created pod: e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

openshift-ingress

deployment-controller

e2e-extmod-b-5711cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-5711cf-openshift-default-7f5d5f45 from 0 to 1

openshift-ingress

multus

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

AddedInterface

Add eth0 [10.134.0.218/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-5711cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-5711cf-565c95b4c5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

AddedInterface

Add eth0 [10.134.0.221/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5711cf-565c95b4c5

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-5711cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5711cf: serviceaccount "payload-processing-e2e-extmod-b-5711cf" not found

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-35936b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-35936b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-5711cf-565c95b4c5

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-5711cf-565c95b4c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-5711cf: serviceaccount "payload-processing-e2e-extmod-b-5711cf" not found

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn

AddedInterface

Add eth0 [10.134.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

ProbeError

Startup probe error: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

Unhealthy

Startup probe failed: Get "http://10.134.0.213:15021/healthz/ready": dial tcp 10.134.0.213:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-b-fb5766-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-fb5766-openshift-default-79bb9d756f from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-b-fb5766-openshift-default-79bb9d756f

SuccessfulCreate

Created pod: e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fb5766-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

AddedInterface

Add eth0 [10.134.0.223/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-mj2h9
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-35936b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-35936b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

ProbeError

Startup probe error: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

Unhealthy

Startup probe failed: Get "http://10.134.0.223:15021/healthz/ready": dial tcp 10.134.0.223:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

ProbeError

Readiness probe error: Get "http://10.134.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

Unhealthy

Readiness probe failed: Get "http://10.134.0.218:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-tq59l

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-tq59l

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 6 to 5
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

Unhealthy

Startup probe failed: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

ProbeError

Startup probe error: Get "http://10.134.0.218:15021/healthz/ready": dial tcp 10.134.0.218:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5711cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5711cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56687c-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-b-56687c-openshift-default-5d54886fb9

SuccessfulCreate

Created pod: e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

openshift-ingress

deployment-controller

e2e-extmod-b-56687c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-56687c-openshift-default-5d54886fb9 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

AddedInterface

Add eth0 [10.133.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

ProbeError

Startup probe error: Get "http://10.133.1.0:15021/healthz/ready": dial tcp 10.133.1.0:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

Unhealthy

Startup probe failed: Get "http://10.133.1.0:15021/healthz/ready": dial tcp 10.133.1.0:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5711cf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-5711cf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 7 to 6

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jrqjp
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-35936b-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-35936b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-35936b-openshift-default-5f7dd5fc45 from 1 to 2

openshift-ingress

replicaset-controller

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45

SuccessfulCreate

Created pod: e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

Created

Container created

openshift-ingress

multus

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

AddedInterface

Add eth0 [10.133.1.1/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

ProbeError

Startup probe error: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

Unhealthy

Startup probe failed: Get "http://10.133.1.1:15021/healthz/ready": dial tcp 10.133.1.1:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-a-9f53bb-openshift-default-567b58d445

SuccessfulCreate

Created pod: e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

openshift-ingress

deployment-controller

e2e-extmod-a-9f53bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-9f53bb-openshift-default-567b58d445 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9f53bb-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

Created

Container created

openshift-ingress

multus

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

AddedInterface

Add eth0 [10.134.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

Unhealthy

Startup probe failed: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

ProbeError

Startup probe error: Get "http://10.134.0.232:15021/healthz/ready": dial tcp 10.134.0.232:15021: connect: connection refused body:
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-6b76f7948b

FailedCreate

Error creating: pods "payload-processing-external-model-6b76f7948b-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

replicaset-controller

payload-processing-external-model-6b76f7948b

SuccessfulCreate

Created pod: payload-processing-external-model-6b76f7948b-5t8cf

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6b76f7948b from 0 to 1

models-as-a-service

multus

payload-processing-external-model-6b76f7948b-5t8cf

AddedInterface

Add eth0 [10.134.0.235/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-6b76f7948b-5t8cf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6b76f7948b-5t8cf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-6b76f7948b-5t8cf

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulCreate

Created pod: payload-processing-external-model-855b7646c4-27w2s

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-27w2s

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-27w2s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-855b7646c4-27w2s

AddedInterface

Add eth0 [10.133.1.10/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-27w2s

Created

Container created

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulDelete

Deleted pod: payload-processing-external-model-855b7646c4-27w2s

models-as-a-service

replicaset-controller

payload-processing-external-model-8444774d4b

SuccessfulCreate

Created pod: payload-processing-external-model-8444774d4b-dvzrf

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-27w2s

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-dvzrf

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-dvzrf

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-dvzrf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-8444774d4b-dvzrf

AddedInterface

Add eth0 [10.134.0.238/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-a-917da2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-917da2-openshift-default-578f45548f from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-917da2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-917da2-openshift-default-578f45548f

SuccessfulCreate

Created pod: e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

openshift-ingress

multus

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

AddedInterface

Add eth0 [10.133.1.11/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cbeebd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

AddedInterface

Add eth0 [10.134.0.239/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65

SuccessfulCreate

Created pod: e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

openshift-ingress

deployment-controller

e2e-extmod-a-cbeebd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65 from 1 to 2

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-dvzrf

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-8444774d4b

SuccessfulDelete

Deleted pod: payload-processing-external-model-8444774d4b-dvzrf

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulCreate

Created pod: payload-processing-external-model-855b7646c4-fnxx9

models-as-a-service

replicaset-controller

payload-processing-external-model-8444774d4b

SuccessfulCreate

Created pod: payload-processing-external-model-8444774d4b-b2wgn

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-fnxx9

Started

Container started
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-8444774d4b from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulDelete

Deleted pod: payload-processing-external-model-855b7646c4-fnxx9

models-as-a-service

multus

payload-processing-external-model-855b7646c4-fnxx9

AddedInterface

Add eth0 [10.134.0.240/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-fnxx9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-fnxx9

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-b2wgn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-8444774d4b-b2wgn

AddedInterface

Add eth0 [10.133.1.12/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n7vfj

Started

Container started

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-hs9mc

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-hs9mc

AddedInterface

Add eth0 [10.134.0.242/23] from ovn-kubernetes

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-n7vfj

AddedInterface

Add eth0 [10.132.0.189/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 5 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n7vfj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n7vfj

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-fwgj9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-vkhvr

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-fnxx9

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-n7vfj
(x6)

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

Unhealthy

Startup probe failed: Get "http://10.133.1.11:15021/healthz/ready": dial tcp 10.133.1.11:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-b2wgn

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-b2wgn

Created

Container created

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-fcrct
(x6)

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

ProbeError

Startup probe error: Get "http://10.133.1.11:15021/healthz/ready": dial tcp 10.133.1.11:15021: connect: connection refused body:

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-fwgj9

AddedInterface

Add eth0 [10.134.0.241/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hs9mc

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fwgj9

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fcrct

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fwgj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fwgj9

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-vkhvr

AddedInterface

Add eth0 [10.133.1.13/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fcrct

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hs9mc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fcrct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hs9mc

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-fcrct

AddedInterface

Add eth0 [10.134.0.243/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

ProbeError

Startup probe error: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

Unhealthy

Startup probe failed: Get "http://10.134.0.239:15021/healthz/ready": dial tcp 10.134.0.239:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 8 to 7

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulDelete

Deleted pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-f49f2

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n7vfj

ProbeError

Startup probe error: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n7vfj

Unhealthy

Startup probe failed: Get "http://10.132.0.189:15021/healthz/ready": dial tcp 10.132.0.189:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-8444774d4b

SuccessfulDelete

Deleted pod: payload-processing-external-model-8444774d4b-b2wgn
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-8444774d4b from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulCreate

Created pod: payload-processing-external-model-855b7646c4-2wc6s

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n7vfj

ProbeError

Startup probe error: Get "http://10.132.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-8444774d4b-b2wgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-n7vfj

Unhealthy

Startup probe failed: Get "http://10.132.0.189:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

ProbeError

Startup probe error: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Unhealthy

Startup probe failed: Get "http://10.133.1.13:15021/healthz/ready": dial tcp 10.133.1.13:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5f57c946bf from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-5f57c946bf

SuccessfulCreate

Created pod: payload-processing-external-model-5f57c946bf-9gvjt

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulDelete

Deleted pod: payload-processing-external-model-855b7646c4-2wc6s

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-2wc6s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fwgj9

Unhealthy

Startup probe failed: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-855b7646c4 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulCreate

Created pod: payload-processing-external-model-855b7646c4-449q9
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hs9mc

Unhealthy

Startup probe failed: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused

models-as-a-service

replicaset-controller

payload-processing-external-model-5f57c946bf

SuccessfulDelete

Deleted pod: payload-processing-external-model-5f57c946bf-9gvjt

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5f57c946bf from 1 to 0

models-as-a-service

multus

payload-processing-external-model-855b7646c4-2wc6s

AddedInterface

Add eth0 [10.134.0.245/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5f57c946bf-9gvjt

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-449q9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x13)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-hs9mc

ProbeError

Startup probe error: Get "http://10.134.0.242:15021/healthz/ready": dial tcp 10.134.0.242:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-2wc6s

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-2wc6s

Created

Container created
(x12)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fcrct

Unhealthy

Startup probe failed: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused

models-as-a-service

multus

payload-processing-external-model-855b7646c4-449q9

AddedInterface

Add eth0 [10.133.1.15/23] from ovn-kubernetes

models-as-a-service

multus

payload-processing-external-model-5f57c946bf-9gvjt

AddedInterface

Add eth0 [10.134.0.246/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5f57c946bf-9gvjt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x13)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fwgj9

ProbeError

Startup probe error: Get "http://10.134.0.241:15021/healthz/ready": dial tcp 10.134.0.241:15021: connect: connection refused body:

models-as-a-service

kubelet

payload-processing-external-model-5f57c946bf-9gvjt

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-449q9

Started

Container started
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Unhealthy

Startup probe failed: Get "http://10.133.1.13:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-449q9

Created

Container created
(x3)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

ProbeError

Startup probe error: Get "http://10.133.1.13:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

kubelet

payload-processing-external-model-5f57c946bf-9gvjt

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-2wc6s

Killing

Stopping container payload-processing
(x13)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fcrct

ProbeError

Startup probe error: Get "http://10.134.0.243:15021/healthz/ready": dial tcp 10.134.0.243:15021: connect: connection refused body:

models-as-a-service

replicaset-controller

payload-processing-external-model-855b7646c4

SuccessfulDelete

Deleted pod: payload-processing-external-model-855b7646c4-449q9

models-as-a-service

replicaset-controller

payload-processing-external-model-68fb489997

SuccessfulCreate

Created pod: payload-processing-external-model-68fb489997-rw4h2

models-as-a-service

kubelet

payload-processing-external-model-855b7646c4-449q9

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-68fb489997 from 0 to 1
(x4)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-855b7646c4 from 1 to 0

models-as-a-service

multus

payload-processing-external-model-68fb489997-rw4h2

AddedInterface

Add eth0 [10.133.1.16/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-68fb489997-rw4h2

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-68fb489997-rw4h2

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-68fb489997-rw4h2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6b76f7948b from 1 to 0

models-as-a-service

replicaset-controller

payload-processing-external-model-6b76f7948b

SuccessfulDelete

Deleted pod: payload-processing-external-model-6b76f7948b-5t8cf

models-as-a-service

kubelet

payload-processing-external-model-6b76f7948b-5t8cf

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-sb26w
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-sb26w

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sb26w

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sb26w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sb26w

Created

Container created

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulDelete

Deleted pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 7 to 6

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-h8xv6

Killing

Stopping container istio-proxy

models-as-a-service

kubelet

payload-processing-external-model-68fb489997-rw4h2

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 7 to 6

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-c46kn

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9265bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9265bf

openshift-ingress

replicaset-controller

e2e-inf-a-9265bf-openshift-default-795bdb684c

SuccessfulCreate

Created pod: e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

openshift-ingress

deployment-controller

e2e-inf-a-9265bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9265bf-openshift-default-795bdb684c from 0 to 1

openshift-ingress

multus

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

AddedInterface

Add eth0 [10.133.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 6 to 5

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-w2v4k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-6lxr9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9265bf: serviceaccount "payload-processing-e2e-inf-a-9265bf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9265bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9265bf: serviceaccount "payload-processing-e2e-inf-a-9265bf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9265bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9265bf-74b4b7dbcc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq

AddedInterface

Add eth0 [10.134.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms

AddedInterface

Add eth0 [10.134.0.252/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq

Created

Container created

openshift-ingress

replicaset-controller

e2e-inf-b-60ad03-openshift-default-b4f95cf65

SuccessfulCreate

Created pod: e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

openshift-ingress

deployment-controller

e2e-inf-b-60ad03-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-60ad03-openshift-default-b4f95cf65 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-60ad03

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-60ad03

openshift-ingress

multus

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

AddedInterface

Add eth0 [10.133.1.29/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

Unhealthy

Readiness probe failed: Get "http://10.133.1.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

ProbeError

Readiness probe error: Get "http://10.133.1.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-60ad03-6bfcb8f847

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-60ad03-6bfcb8f847

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-60ad03-6bfcb8f847-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-60ad03: serviceaccount "payload-processing-e2e-inf-b-60ad03" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-60ad03: serviceaccount "payload-processing-e2e-inf-b-60ad03" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-60ad03

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-60ad03

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-60ad03-6bfcb8f847 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4

AddedInterface

Add eth0 [10.133.1.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

AddedInterface

Add eth0 [10.134.0.253/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

Unhealthy

Startup probe failed: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

ProbeError

Startup probe error: Get "http://10.133.1.26:15021/healthz/ready": dial tcp 10.133.1.26:15021: connect: connection refused body:
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9265bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9265bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9265bf-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9265bf-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-inf-a-a68103-openshift-default-b8566486f

SuccessfulCreate

Created pod: e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a68103

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a68103
(x2)

openshift-ingress

kubelet

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

Created

Container created

openshift-ingress

deployment-controller

e2e-inf-a-a68103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a68103-openshift-default-b8566486f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

AddedInterface

Add eth0 [10.133.1.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a68103-7f656d6f67

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a68103-54dc494f95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a68103-54dc494f95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a68103: serviceaccount "payload-processing-e2e-inf-a-a68103" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a68103

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a68103-7f656d6f67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a68103

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a68103-54dc494f95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a68103-54dc494f95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a68103-7f656d6f67

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a68103-7f656d6f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a68103: serviceaccount "payload-processing-e2e-inf-a-a68103" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc

AddedInterface

Add eth0 [10.134.1.3/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs

AddedInterface

Add eth0 [10.133.1.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

Unhealthy

Startup probe failed: Get "http://10.133.1.29:15021/healthz/ready": dial tcp 10.133.1.29:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

ProbeError

Startup probe error: Get "http://10.133.1.29:15021/healthz/ready": dial tcp 10.133.1.29:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-60ad03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-60ad03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-inf-a-055d82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-055d82

openshift-ingress

replicaset-controller

e2e-inf-a-055d82-openshift-default-79544dc787

SuccessfulCreate

Created pod: e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

openshift-ingress

deployment-controller

e2e-inf-a-055d82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-055d82-openshift-default-79544dc787 from 0 to 1

openshift-ingress

multus

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

AddedInterface

Add eth0 [10.134.1.6/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-60ad03-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-055d82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-055d82-78f96f8749 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-055d82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-055d82-5d88457c99 from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-60ad03-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-055d82-5d88457c99

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-055d82-5d88457c99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-055d82: serviceaccount "payload-processing-e2e-inf-a-055d82" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-055d82-78f96f8749

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-055d82-78f96f8749

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-055d82-78f96f8749-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-055d82: serviceaccount "payload-processing-e2e-inf-a-055d82" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

AddedInterface

Add eth0 [10.134.1.7/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-055d82-5d88457c99

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

openshift-ingress

kubelet

payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj

AddedInterface

Add eth0 [10.133.1.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-055d82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-055d82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-inf-a-9265bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9265bf-openshift-default-795bdb684c from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-9265bf-openshift-default-795bdb684c

SuccessfulCreate

Created pod: e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-9265bf-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

AddedInterface

Add eth0 [10.134.1.22/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3eb43f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3eb43f

openshift-ingress

deployment-controller

e2e-inf-b-3eb43f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3eb43f-openshift-default-5ff498f587 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-3eb43f-openshift-default-5ff498f587

SuccessfulCreate

Created pod: e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

openshift-ingress

multus

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

AddedInterface

Add eth0 [10.133.1.58/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

Unhealthy

Startup probe failed: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

ProbeError

Startup probe error: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3eb43f-7fbc776f89

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3eb43f-7fbc776f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3eb43f: serviceaccount "payload-processing-e2e-inf-b-3eb43f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3eb43f-7fbc776f89

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3eb43f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3eb43f-7fbc776f89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3eb43f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3eb43f: serviceaccount "payload-processing-e2e-inf-b-3eb43f" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

AddedInterface

Add eth0 [10.134.1.23/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6

AddedInterface

Add eth0 [10.134.1.24/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6

Started

Container started

openshift-ingress

replicaset-controller

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df

SuccessfulDelete

Deleted pod: e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-47a8a4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df from 3 to 2

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-vd55r

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Unhealthy

Readiness probe failed: Get "http://10.133.1.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

ProbeError

Readiness probe error: Get "http://10.133.1.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Started

Container started

openshift-ingress

replicaset-controller

e2e-inf-b-24376f-openshift-default-8df4546fc

SuccessfulCreate

Created pod: e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

openshift-ingress

deployment-controller

e2e-inf-b-24376f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-24376f-openshift-default-8df4546fc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-24376f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-24376f

openshift-ingress

multus

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

AddedInterface

Add eth0 [10.134.1.25/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Unhealthy

Startup probe failed: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

ProbeError

Startup probe error: Get "http://10.133.1.38:15021/healthz/ready": dial tcp 10.133.1.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-24376f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-24376f-57858f46c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-24376f-7c65966447

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-24376f-7c65966447

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-24376f-7c65966447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-24376f: serviceaccount "payload-processing-e2e-inf-b-24376f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-24376f-57858f46c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-24376f-57858f46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-24376f: serviceaccount "payload-processing-e2e-inf-b-24376f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-24376f-57858f46c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-24376f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-24376f-7c65966447 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk

AddedInterface

Add eth0 [10.133.1.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d

AddedInterface

Add eth0 [10.133.1.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-inf-a-68aa46

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-68aa46

openshift-ingress

deployment-controller

e2e-inf-a-68aa46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-68aa46-openshift-default-696d457fcf from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-68aa46-openshift-default-696d457fcf

SuccessfulCreate

Created pod: e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a68103-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

AddedInterface

Add eth0 [10.133.1.64/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a68103-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-inf-a-055d82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-055d82-openshift-default-79544dc787 from 1 to 4

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-srrmg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-055d82-openshift-default-79544dc787

SuccessfulCreate

Created pod: e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

openshift-ingress

replicaset-controller

e2e-inf-a-055d82-openshift-default-79544dc787

SuccessfulCreate

Created pod: e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

openshift-ingress

replicaset-controller

e2e-inf-a-055d82-openshift-default-79544dc787

SuccessfulCreate

Created pod: e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-055d82-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

AddedInterface

Add eth0 [10.133.1.65/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

AddedInterface

Add eth0 [10.133.1.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

Started

Container started

openshift-ingress

multus

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

AddedInterface

Add eth0 [10.134.1.26/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-bl8fb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

ProbeError

Readiness probe error: Get "http://10.134.1.6:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

Unhealthy

Readiness probe failed: Get "http://10.134.1.6:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

Unhealthy

Startup probe failed: Get "http://10.134.1.26:15021/healthz/ready": dial tcp 10.134.1.26:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

ProbeError

Startup probe error: Get "http://10.134.1.26:15021/healthz/ready": dial tcp 10.134.1.26:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

ProbeError

Startup probe error: Get "http://10.133.1.65:15021/healthz/ready": dial tcp 10.133.1.65:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

Unhealthy

Startup probe failed: Get "http://10.133.1.65:15021/healthz/ready": dial tcp 10.133.1.65:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

Unhealthy

Startup probe failed: Get "http://10.133.1.66:15021/healthz/ready": dial tcp 10.133.1.66:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

ProbeError

Startup probe error: Get "http://10.133.1.66:15021/healthz/ready": dial tcp 10.133.1.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-68aa46

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-68aa46-85cbd56d69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-68aa46-85cbd56d69

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9
(x7)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

Unhealthy

Startup probe failed: Get "http://10.134.1.6:15021/healthz/ready": dial tcp 10.134.1.6:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

ProbeError

Startup probe error: Get "http://10.134.1.6:15021/healthz/ready": dial tcp 10.134.1.6:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-68aa46-85cbd56d69

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-68aa46-85cbd56d69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-68aa46: serviceaccount "payload-processing-e2e-inf-a-68aa46" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-68aa46

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-68aa46: serviceaccount "payload-processing-e2e-inf-a-68aa46" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k

AddedInterface

Add eth0 [10.134.1.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9

AddedInterface

Add eth0 [10.134.1.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-055d82-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-055d82-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-inf-a-b13404-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b13404-openshift-default-7d5579f55 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-b13404

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-b13404

openshift-ingress

replicaset-controller

e2e-inf-a-b13404-openshift-default-7d5579f55

SuccessfulCreate

Created pod: e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85
(x2)

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

Started

Container started

openshift-ingress

multus

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

AddedInterface

Add eth0 [10.133.1.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-b13404

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-b13404-766b656b97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b13404-766b656b97

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-b13404

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-b13404-f996d75f from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-24376f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b13404-f996d75f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b13404-f996d75f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-b13404-f996d75f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b13404: serviceaccount "payload-processing-e2e-inf-a-b13404" not found
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-24376f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b13404-766b656b97

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-b13404-766b656b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b13404: serviceaccount "payload-processing-e2e-inf-a-b13404" not found
(x6)

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

Unhealthy

Startup probe failed: Get "http://10.134.1.25:15021/healthz/ready": dial tcp 10.134.1.25:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s

AddedInterface

Add eth0 [10.133.1.74/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

ProbeError

Startup probe error: Get "http://10.134.1.25:15021/healthz/ready": dial tcp 10.134.1.25:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s

Created

Container created

openshift-ingress

multus

payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

AddedInterface

Add eth0 [10.133.1.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

Unhealthy

Startup probe failed: Get "http://10.133.1.58:15021/healthz/ready": dial tcp 10.133.1.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

ProbeError

Startup probe error: Get "http://10.133.1.58:15021/healthz/ready": dial tcp 10.133.1.58:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c0a748

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c0a748

openshift-ingress

deployment-controller

e2e-inf-b-c0a748-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c0a748-openshift-default-6f4f79d795 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-3eb43f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-3eb43f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

e2e-inf-b-c0a748-openshift-default-6f4f79d795

SuccessfulCreate

Created pod: e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

openshift-ingress

multus

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

AddedInterface

Add eth0 [10.133.1.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-fl9r4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-a68103-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-inf-a-a68103-openshift-default-b8566486f

SuccessfulCreate

Created pod: e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

openshift-ingress

deployment-controller

e2e-inf-a-a68103-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a68103-openshift-default-b8566486f from 1 to 2

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c0a748: serviceaccount "payload-processing-e2e-inf-b-c0a748" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c0a748

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c0a748-76c9674b77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c0a748-76c9674b77

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c0a748-76c9674b77

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c0a748-76c9674b77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c0a748: serviceaccount "payload-processing-e2e-inf-b-c0a748" not found

openshift-ingress

multus

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

AddedInterface

Add eth0 [10.134.1.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c0a748

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

AddedInterface

Add eth0 [10.133.1.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts

AddedInterface

Add eth0 [10.133.1.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b13404-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b13404-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

Unhealthy

Startup probe failed: Get "http://10.134.1.33:15021/healthz/ready": dial tcp 10.134.1.33:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

ProbeError

Startup probe error: Get "http://10.134.1.33:15021/healthz/ready": dial tcp 10.134.1.33:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-3eb43f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-3eb43f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-24376f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-24376f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

ProbeError

Startup probe error: Get "http://10.133.1.64:15021/healthz/ready": dial tcp 10.133.1.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

Unhealthy

Startup probe failed: Get "http://10.133.1.64:15021/healthz/ready": dial tcp 10.133.1.64:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-9143e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9143e1-openshift-default-5cbd6c78ff from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff

SuccessfulCreate

Created pod: e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9143e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9143e1

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fwgj9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 10 to 9

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-fwgj9

openshift-ingress

deployment-controller

e2e-inf-b-24376f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-24376f-openshift-default-8df4546fc from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-b-24376f-openshift-default-8df4546fc

SuccessfulCreate

Created pod: e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-24376f-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fwgj9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

AddedInterface

Add eth0 [10.134.1.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9143e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9143e1-866d986d75 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9143e1-866d986d75

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9143e1-866d986d75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9143e1: serviceaccount "payload-processing-e2e-inf-b-9143e1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9143e1-bffbfb589

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9143e1-866d986d75

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9143e1-bffbfb589

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9143e1-bffbfb589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9143e1: serviceaccount "payload-processing-e2e-inf-b-9143e1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9143e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9143e1-bffbfb589 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

Started

Container started

openshift-ingress

multus

payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

AddedInterface

Add eth0 [10.134.1.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9

AddedInterface

Add eth0 [10.133.1.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

ProbeError

Readiness probe error: Get "http://10.133.1.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

Unhealthy

Readiness probe failed: Get "http://10.133.1.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-68aa46-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-68aa46-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

ProbeError

Startup probe error: Get "http://10.133.1.72:15021/healthz/ready": dial tcp 10.133.1.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

Unhealthy

Startup probe failed: Get "http://10.133.1.72:15021/healthz/ready": dial tcp 10.133.1.72:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b13404-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b13404-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9143e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9143e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9265bf-74b4b7dbcc-7j9ms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9265bf-74cf46f5ff-kx4lq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-tzvhb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

ProbeError

Readiness probe error: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-a-9265bf-openshift-default-795bdb684c-s7cgs

Unhealthy

Readiness probe failed: Get "http://10.134.1.22:15021/healthz/ready": dial tcp 10.134.1.22:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

AddedInterface

Add eth0 [10.133.1.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

Unhealthy

Startup probe failed: Get "http://10.134.1.35:15021/healthz/ready": dial tcp 10.134.1.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

ProbeError

Startup probe error: Get "http://10.134.1.35:15021/healthz/ready": dial tcp 10.134.1.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

Unhealthy

Startup probe failed: Get "http://10.133.1.84:15021/healthz/ready": dial tcp 10.133.1.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

ProbeError

Startup probe error: Get "http://10.133.1.84:15021/healthz/ready": dial tcp 10.133.1.84:15021: connect: connection refused body:
(x2)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Unhealthy

Readiness probe failed: Get "https://10.133.0.40:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9143e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-9143e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-60ad03-6bfcb8f847-545j4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-60ad03-666dbb97d7-g8x4w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-010232-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-010232-openshift-default-5bfcc95779 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-010232-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w1-010232-openshift-default-5bfcc95779

SuccessfulDelete

Deleted pod: e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

openshift-ingress

kubelet

e2e-inf-b-60ad03-openshift-default-b4f95cf65-9jtpt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-5hnmn

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-vhlpq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8bgnr

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fcrct

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 9 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-fcrct

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fcrct

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-inf-a-b13404-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b13404-openshift-default-7d5579f55 from 1 to 2

openshift-ingress

replicaset-controller

e2e-inf-a-b13404-openshift-default-7d5579f55

SuccessfulCreate

Created pod: e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b13404-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

AddedInterface

Add eth0 [10.134.1.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

Created

Container created

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

Unhealthy

Startup probe failed: Get "http://10.134.1.41:15021/healthz/ready": dial tcp 10.134.1.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

ProbeError

Startup probe error: Get "http://10.134.1.41:15021/healthz/ready": dial tcp 10.134.1.41:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-fv94c

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-6cc458d887-7hrjn
(x3)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-6cc458d887 from 8 to 10

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fv94c

Started

Container started

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-fv94c

AddedInterface

Add eth0 [10.134.1.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-6cc458d887-7hrjn

AddedInterface

Add eth0 [10.133.1.86/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fv94c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fv94c

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 6 to 5

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulDelete

Deleted pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-8bb45
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fv94c

Unhealthy

Startup probe failed: Get "http://10.134.1.42:15021/healthz/ready": dial tcp 10.134.1.42:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

Unhealthy

Startup probe failed: Get "http://10.133.1.86:15021/healthz/ready": dial tcp 10.133.1.86:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

ProbeError

Startup probe error: Get "http://10.133.1.86:15021/healthz/ready": dial tcp 10.133.1.86:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-fv94c

ProbeError

Startup probe error: Get "http://10.134.1.42:15021/healthz/ready": dial tcp 10.134.1.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-055d82-78f96f8749-b4vpj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

Killing

Stopping container istio-proxy
(x22)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Unhealthy

Readiness probe failed: Get "https://10.133.0.40:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-bln7k

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-055d82-5d88457c99-w5252

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

llm

kubelet

echo-simulator-kserve-64b6f8f96c-lrkj6

Unhealthy

Readiness probe failed: Get "https://10.133.0.39:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-jbsql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-q64dp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-055d82-openshift-default-79544dc787-b9l6c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

deployment-controller

e2e-worker-w4-d5d3c3-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9 from 3 to 2

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-jsg2m
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-d5d3c3-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f

SuccessfulDelete

Deleted pod: e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-bmzgx

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-e92a08-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w4-e92a08-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w4-e92a08-openshift-default-7694cb68f from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 5 to 4

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulDelete

Deleted pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-br72t

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a68103-7f656d6f67-clkbs

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-56687c-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-56687c-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-56687c-openshift-default-5d54886fb9 from 2 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-56687c-openshift-default-5d54886fb9

SuccessfulDelete

Deleted pod: e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

openshift-ingress

deployment-controller

e2e-extmod-a-cbeebd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65 from 2 to 1

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-l7nwr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-cbeebd-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65

SuccessfulDelete

Deleted pod: e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-8ndxm
(x2)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-inf-b-c0a748-openshift-default-6f4f79d795

SuccessfulCreate

Created pod: e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

openshift-ingress

replicaset-controller

e2e-inf-b-c0a748-openshift-default-6f4f79d795

SuccessfulCreate

Created pod: e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

openshift-ingress

replicaset-controller

e2e-inf-b-c0a748-openshift-default-6f4f79d795

SuccessfulCreate

Created pod: e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

openshift-ingress

deployment-controller

e2e-inf-b-c0a748-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c0a748-openshift-default-6f4f79d795 from 1 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c0a748-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

Created

Container created

openshift-ingress

multus

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-inf-b-24376f-57858f46c-ghv5d

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

AddedInterface

Add eth0 [10.134.1.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

Started

Container started

openshift-ingress

multus

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

AddedInterface

Add eth0 [10.134.1.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-p5v4g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

Unhealthy

Startup probe failed: Get "http://10.133.1.75:15021/healthz/ready": dial tcp 10.133.1.75:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

ProbeError

Startup probe error: Get "http://10.133.1.75:15021/healthz/ready": dial tcp 10.133.1.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-a68103-openshift-default-b8566486f-8jgl8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

ProbeError

Startup probe error: Get "http://10.134.1.46:15021/healthz/ready": dial tcp 10.134.1.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

Unhealthy

Startup probe failed: Get "http://10.134.1.45:15021/healthz/ready": dial tcp 10.134.1.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

Unhealthy

Startup probe failed: Get "http://10.134.1.46:15021/healthz/ready": dial tcp 10.134.1.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

ProbeError

Startup probe error: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

Unhealthy

Startup probe failed: Get "http://10.132.0.196:15021/healthz/ready": dial tcp 10.132.0.196:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

ProbeError

Startup probe error: Get "http://10.134.1.45:15021/healthz/ready": dial tcp 10.134.1.45:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-b13404-openshift-default-7d5579f55

SuccessfulCreate

Created pod: e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

openshift-ingress

deployment-controller

e2e-inf-a-b13404-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b13404-openshift-default-7d5579f55 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-a-b13404-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

Created

Container created
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a68103-54dc494f95-66nnc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

Started

Container started

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3eb43f-67c99d44bc-zd9c6

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c0a748-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c0a748-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-rx2hq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

ProbeError

Startup probe error: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

Unhealthy

Startup probe failed: Get "http://10.132.0.197:15021/healthz/ready": dial tcp 10.132.0.197:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3eb43f-7fbc776f89-p5hh4

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.1.23:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-inf-b-24376f-openshift-default-8df4546fc-85hw4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-24376f-7c65966447-4bkpk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c0a748-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c0a748-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-shared-b-w2-e11de4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65 from 2 to 1

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65

SuccessfulDelete

Deleted pod: e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-g95wb

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-e11de4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-fpbnt

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulDelete

Deleted pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-tgztq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-sb26w

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-sb26w
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target
(x2)

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-b76c62-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-b76c62-openshift-default-7f44764669

SuccessfulDelete

Deleted pod: e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-8s4w6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-b76c62-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-b76c62-openshift-default-7f44764669 from 2 to 1

openshift-ingress

kubelet

e2e-inf-b-3eb43f-openshift-default-5ff498f587-hf4ss

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-c0a748-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c0a748-openshift-default-6f4f79d795 from 4 to 6

openshift-ingress

replicaset-controller

e2e-extmod-b-fb5766-openshift-default-79bb9d756f

SuccessfulDelete

Deleted pod: e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-9lct6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-c0a748-openshift-default-6f4f79d795

SuccessfulCreate

Created pod: e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-fb5766-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-fb5766-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-fb5766-openshift-default-79bb9d756f from 2 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-c0a748-openshift-default-6f4f79d795

SuccessfulCreate

Created pod: e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

openshift-ingress

horizontal-pod-autoscaler

e2e-inf-b-c0a748-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

Created

Container created

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

Started

Container started

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

Created

Container created

openshift-ingress

multus

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

AddedInterface

Add eth0 [10.133.1.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

Started

Container started

openshift-ingress

multus

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

ProbeError

Startup probe error: Get "http://10.132.0.198:15021/healthz/ready": dial tcp 10.132.0.198:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

Unhealthy

Startup probe failed: Get "http://10.132.0.198:15021/healthz/ready": dial tcp 10.132.0.198:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

Unhealthy

Startup probe failed: Get "http://10.133.1.96:15021/healthz/ready": dial tcp 10.133.1.96:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

ProbeError

Startup probe error: Get "http://10.133.1.96:15021/healthz/ready": dial tcp 10.133.1.96:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-68aa46-85cbd56d69-8fh6k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-9f53bb-openshift-default-567b58d445

SuccessfulDelete

Deleted pod: e2e-extmod-a-9f53bb-openshift-default-567b58d445-4bqf2

openshift-ingress

deployment-controller

e2e-extmod-a-9f53bb-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-9f53bb-openshift-default-567b58d445 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-9f53bb-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

kubelet

e2e-inf-a-68aa46-openshift-default-696d457fcf-8fcrl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-68aa46-7fbb47ffc9-2zvd9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c0a748-76c9674b77-x44ts

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.1.77:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-slblz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-s64xk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-xd2m5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-stlsd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-wrjh7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-c0a748-openshift-default-6f4f79d795-r5nbp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-mt-049d3b4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-049d3b4c-openshift-default-9b7d7b57c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-049d3b4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-049d3b4c

openshift-ingress

replicaset-controller

e2e-mt-049d3b4c-openshift-default-9b7d7b57c

SuccessfulCreate

Created pod: e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

openshift-ingress

multus

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

AddedInterface

Add eth0 [10.134.1.47/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-049d3b4c: serviceaccount "payload-processing-e2e-mt-049d3b4c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx

openshift-ingress

deployment-controller

payload-processing-e2e-mt-049d3b4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-049d3b4c-6f95dfffdf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-049d3b4c-6f95dfffdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-049d3b4c-6f95dfffdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-049d3b4c: serviceaccount "payload-processing-e2e-mt-049d3b4c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-049d3b4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-049d3b4c-6f95dfffdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh

AddedInterface

Add eth0 [10.133.1.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx

AddedInterface

Add eth0 [10.133.1.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c0a748-6f744bc5f9-f6xmx

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.1.76:50052" within 1s: context deadline exceeded
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-b1c6f6-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x6)

openshift-ingress

deployment-controller

e2e-worker-w3-b1c6f6-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc from 3 to 2

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc

SuccessfulDelete

(combined from similar events): Deleted pod: e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g
(x2)

openshift-ingress

kubelet

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-6h57g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

Unhealthy

Startup probe failed: Get "http://10.134.1.47:15021/healthz/ready": dial tcp 10.134.1.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

ProbeError

Startup probe error: Get "http://10.134.1.47:15021/healthz/ready": dial tcp 10.134.1.47:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-74hrv

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lrmsr

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-lrmsr

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-74hrv

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5p4bj

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-5p4bj

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x16)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-9qjlw

Unhealthy

Readiness probe failed: Get "https://10.133.0.40:8000/ready": context deadline exceeded
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-049d3b4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-049d3b4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-049d3b4c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-049d3b4c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-049d3b4c-6f95dfffdf-h6dqh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-049d3b4c-54d6b698d7-mrcpx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-jf495

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-wmnxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-b13404-openshift-default-7d5579f55-7rp85

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-049d3b4c-openshift-default-9b7d7b57c-xfs6g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b13404-f996d75f-xd57s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b13404-766b656b97-mngzq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

Unhealthy

Readiness probe failed: Get "http://10.133.1.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

ProbeError

Readiness probe error: Get "http://10.133.0.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-c7n4c

Unhealthy

Readiness probe failed: Get "http://10.133.0.19:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

ProbeError

Readiness probe error: Get "http://10.133.1.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9143e1-bffbfb589-f687v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9143e1-866d986d75-pxkw9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-inf-b-9143e1-openshift-default-5cbd6c78ff-f98lz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-extmod-b-d9f2ce-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-d9f2ce-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf

SuccessfulDelete

Deleted pod: e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-n55ps

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-917da2-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-917da2-openshift-default-578f45548f

SuccessfulDelete

Deleted pod: e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

openshift-ingress

deployment-controller

e2e-extmod-a-917da2-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-917da2-openshift-default-578f45548f from 2 to 1

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mbnr8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-9f53bb-openshift-default-567b58d445-snqfs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df

SuccessfulDelete

Deleted pod: e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-lzx6h

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-47a8a4-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w2-47a8a4-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df from 2 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-e78c33-openshift-default

SuccessfulRescale

(combined from similar events): New size: 2; reason: All metrics below target
(x4)

openshift-ingress

deployment-controller

e2e-worker-w2-e78c33-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67

SuccessfulDelete

Deleted pod: e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-js9t8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-9f53bb-74c95f4db5-2b47g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-9f53bb-57f76df9cf-8bglv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-d9f2ce-75745f59f9-rl99s

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-7jdrg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-d9f2ce-openshift-default-6ffcd4dddf-jkckh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-d9f2ce-66f5865b5f-c5s4f

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-47a8a4-openshift-default-54fbfbc8df-2lbgj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-47a8a4-778f5555cf-zftld

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-47a8a4-774b5b78cf-465dr

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-cbeebd-openshift-default-5ff84cbf65-v7rj2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-cbeebd-66677c6dd9-9vbb6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-cbeebd-85b755db8c-vrdvs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-e11de4-549d7f476c-jvlfn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-e11de4-59444986f9-5f2gs

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w2-e11de4-openshift-default-c8b8f9f65-p6fhp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-b76c62-69b644f695-msztm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-b76c62-65dc767945-zw7rg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-b76c62-openshift-default-7f44764669-7frxb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

Killing

Stopping container payload-processing

opendatahub

kubelet

test-curl-7600-b9ee02

Started

Container started

opendatahub

multus

test-curl-7600-b9ee02

AddedInterface

Add eth0 [10.134.1.54/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7600-b9ee02

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7600-b9ee02

Created

Container created

opendatahub

kubelet

test-curl-7600-ba4287

Started

Container started

opendatahub

kubelet

test-curl-7600-ba4287

Created

Container created

opendatahub

kubelet

test-curl-7600-b9ee02

Killing

Stopping container test-curl-7600-b9ee02

opendatahub

multus

test-curl-7600-ba4287

AddedInterface

Add eth0 [10.134.1.56/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7600-ba4287

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-e78c33-75cd6ff47c-wbvms

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-e78c33-6497cb76ff-jhrwb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

opendatahub

kubelet

test-curl-7600-ba4287

Killing

Stopping container test-curl-7600-ba4287
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-e92a08-5d64d7fdf5-9prtm

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-e92a08-cb5756c95-mb7pz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w4-e92a08-openshift-default-7694cb68f-xz4cw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-rvtbw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-e78c33-openshift-default-5d4fbf8c67-v24hd

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-9c53b2-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w0-9c53b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f from 1 to 2

openshift-ingress

multus

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

AddedInterface

Add eth0 [10.134.1.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f

SuccessfulCreate

Created pod: e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

Unhealthy

Startup probe failed: Get "http://10.134.1.58:15021/healthz/ready": dial tcp 10.134.1.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

ProbeError

Startup probe error: Get "http://10.134.1.58:15021/healthz/ready": dial tcp 10.134.1.58:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-ef1662-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5

SuccessfulCreate

Created pod: e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

openshift-ingress

deployment-controller

e2e-shared-b-w0-ef1662-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5 from 1 to 2

openshift-ingress

multus

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

AddedInterface

Add eth0 [10.134.1.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w4-fcc2ce-openshift-default-74968dd5f7-tlhdb

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-fcc2ce-694c767579-9bf9t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-fcc2ce-78ddfcdd5f-j9kfw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

ProbeError

Startup probe error: Get "http://10.134.1.59:15021/healthz/ready": dial tcp 10.134.1.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

Unhealthy

Startup probe failed: Get "http://10.134.1.59:15021/healthz/ready": dial tcp 10.134.1.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-d5d3c3-7c956d5fff-mgzng

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-d5d3c3-748448dc75-dv65g

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.133.0.64:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-j9qwq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-d5d3c3-openshift-default-67cf884fd9-5kxd5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-185908-openshift-default-795bb9d77-cgh2h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-185908-78b5bdcbff-q72ns

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-185908-5f495fdb69-s9nbp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-56687c-openshift-default-5d54886fb9-w65m4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-56687c-54bf7c6bf5-lnbqk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-56687c-85989ddcb7-5zjws

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-qd7jp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-9c53b2-openshift-default-8474f7657f-m9q7g

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-9c53b2-b89bff74f-snf7l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-917da2-openshift-default-578f45548f-mzzcc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-9c53b2-56fb8d74bc-k82sq

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

deployment-controller

e2e-extmod-a-35936b-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-35936b-openshift-default-5f7dd5fc45 from 2 to 1

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-35936b-openshift-default

SuccessfulRescale

New size: 1; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45

SuccessfulDelete

Deleted pod: e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-x6tv5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-836589-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-b-w3-836589-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-836589-openshift-default-54b68dc845 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w3-836589-openshift-default-54b68dc845

SuccessfulCreate

Created pod: e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

openshift-ingress

multus

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

AddedInterface

Add eth0 [10.133.1.138/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-917da2-5ddb545f6c-8942r

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 2

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-w8jg4

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-w8jg4
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-917da2-5c9fcf7f59-cgr7t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

ProbeError

Startup probe error: Get "http://10.133.1.138:15021/healthz/ready": dial tcp 10.133.1.138:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

Unhealthy

Startup probe failed: Get "http://10.133.1.138:15021/healthz/ready": dial tcp 10.133.1.138:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-kpkn5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w0-ef1662-openshift-default-cf96df6b5-clz5w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-fb5766-openshift-default-79bb9d756f-d9gzn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-ef1662-5fc9b869d7-xzvrh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-ef1662-7994fffb75-ktcdt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-fb5766-fdd496649-vjrxl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-fb5766-59557f68d7-6jpvh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-b9tw2

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-vkhvr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-6cc458d887 from 10 to 7

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-7hrjn

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-7hrjn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-6cc458d887

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-6cc458d887-vkhvr

openshift-ingress

kubelet

e2e-shared-a-w1-6012b5-openshift-default-6c4d9bdd7c-rtpwx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

maas-default-gateway-openshift-default-6cc458d887-b9tw2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-a-w3-ce5555-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-jkmg7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797

SuccessfulCreate

Created pod: e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

openshift-ingress

multus

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

AddedInterface

Add eth0 [10.133.1.147/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-ce5555-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

Created

Container created
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f78621-669d499979-mgwqt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f78621-5c4f6c9d4c-92tkt

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w0-f78621-openshift-default-74d8d5d569-hp2qd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-6012b5-6887bc75f5-wwj4b

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-6012b5-5bcd5d5d55-n97wp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

ProbeError

Startup probe error: Get "http://10.133.1.147:15021/healthz/ready": dial tcp 10.133.1.147:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

Unhealthy

Startup probe failed: Get "http://10.133.1.147:15021/healthz/ready": dial tcp 10.133.1.147:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-35936b-openshift-default-5f7dd5fc45-n66nn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-35936b-555d5645bc-6nc7d

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-35936b-6c4b8b9b95-fdb4q

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w1-cc8214-openshift-default-6b7ff6457c-gj5ps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-5711cf-openshift-default-7f5d5f45-vfqjx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-cc8214-7dd6fcf467-t9w7m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-cc8214-56c49f49f5-r956v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-5711cf-565c95b4c5-57tnh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-5711cf-794f89bc75-gndnn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-010232-dd4979d95-h6pg7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-010232-6bf5dbf45c-zn8sc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-k7lfk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-ce5555-openshift-default-6fc8b94797-nhn95

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ce5555-7967f55dbc-pxlhx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ce5555-76c84548c9-sn442

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-5pm2w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-010232-openshift-default-5bfcc95779-8hn6t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-v44r2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-836589-openshift-default-54b68dc845-gt6pb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-836589-ff48b7b7f-z7vwl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-836589-7589f8657f-6d56t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-b1c6f6-6cd67bc9f7-wnxfv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-b1c6f6-69d745bb99-lbjx9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-2rvkg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-b1c6f6-openshift-default-5fcd7689dc-jxdz7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: