Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z to ip-10-0-133-96.us-east-2.compute.internal

cert-manager

cert-manager-cainjector-5c57bbd4fc-mbp6q

Scheduled

Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-mbp6q to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj to ip-10-0-134-58.us-east-2.compute.internal

cert-manager

cert-manager-webhook-5dbbbf75cc-cjqh2

Scheduled

Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-cjqh2 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s to ip-10-0-133-96.us-east-2.compute.internal

kuadrant-system

authorino-56c6c9ddd5-5vlgx

Scheduled

Successfully assigned kuadrant-system/authorino-56c6c9ddd5-5vlgx to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786 to ip-10-0-137-135.us-east-2.compute.internal

kuadrant-system

authorino-57f7f8659f-zt6bv

Scheduled

Successfully assigned kuadrant-system/authorino-57f7f8659f-zt6bv to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg to ip-10-0-133-96.us-east-2.compute.internal

kuadrant-system

authorino-58966b5867-lsc7q

Scheduled

Successfully assigned kuadrant-system/authorino-58966b5867-lsc7q to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm to ip-10-0-137-135.us-east-2.compute.internal

kuadrant-system

authorino-6867c46776-hlcsj

Scheduled

Successfully assigned kuadrant-system/authorino-6867c46776-hlcsj to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d to ip-10-0-137-135.us-east-2.compute.internal

kuadrant-system

authorino-6889cbd8c4-wzs5x

Scheduled

Successfully assigned kuadrant-system/authorino-6889cbd8c4-wzs5x to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m to ip-10-0-133-96.us-east-2.compute.internal

kuadrant-system

authorino-6dd76875b5-l9ndj

Scheduled

Successfully assigned kuadrant-system/authorino-6dd76875b5-l9ndj to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9 to ip-10-0-134-58.us-east-2.compute.internal

kuadrant-system

authorino-operator-7b7bb4bc77-xwr2j

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-xwr2j to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

Scheduled

Successfully assigned openshift-ingress/e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

Scheduled

Successfully assigned openshift-ingress/e2e-noten-754cee-openshift-default-54666dcff9-k8xdc to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

Scheduled

Successfully assigned openshift-ingress/e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td to ip-10-0-137-135.us-east-2.compute.internal

kuadrant-system

dns-operator-controller-manager-8557cbdb84-k569b

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-k569b to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq to ip-10-0-133-96.us-east-2.compute.internal

kuadrant-system

kuadrant-console-plugin-66c4fb575d-crll9

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-66c4fb575d-crll9 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6 to ip-10-0-134-58.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-hg8tr

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-hg8tr to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h to ip-10-0-134-58.us-east-2.compute.internal

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-tftjb

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-tftjb to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz to ip-10-0-134-58.us-east-2.compute.internal

kuadrant-system

limitador-limitador-74dfcfb894-2j9vp

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-2j9vp to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-5f78687d5b-vfsrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5f78687d5b-vfsrt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn to ip-10-0-133-96.us-east-2.compute.internal

kuadrant-system

limitador-limitador-7c9b87d574-d9fgc

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-d9fgc to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d to ip-10-0-134-58.us-east-2.compute.internal

kuadrant-system

limitador-operator-controller-manager-5778bb4449-w68l9

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-w68l9 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-066928-5866c665f8-pzkx5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-066928-5866c665f8-pzkx5 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-7784e5-79887659d4-5hll8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7784e5-79887659d4-5hll8 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t to ip-10-0-134-58.us-east-2.compute.internal

llm

e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj

Scheduled

Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72 to ip-10-0-133-96.us-east-2.compute.internal

llm

e2e-distinct-simulated-kserve-7b998b79d9-zgw99

Scheduled

Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-zgw99 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7876bfcb74-nqdlt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-nqdlt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-gs6dj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-gs6dj to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-hncld

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-hncld to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-rqh7r

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-rqh7r to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-wlrxd to ip-10-0-137-135.us-east-2.compute.internal

llm

e2e-embedding-simulated-kserve-67bf594cd6-68f2m

Scheduled

Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-68f2m to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-6f89dc687f-bwx2f

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f89dc687f-bwx2f to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

kube-auth-proxy-6f89dc687f-h9g5s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f89dc687f-h9g5s to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-mt-da58b769-7ddb646744-dvj75

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-da58b769-7ddb646744-dvj75 to ip-10-0-134-58.us-east-2.compute.internal

llm

e2e-trlp-test-simulated-kserve-69b588897d-npxnt

Scheduled

Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-npxnt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-78fkg to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-8hjs5 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-bkpg7 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-dhclt to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z to ip-10-0-134-58.us-east-2.compute.internal

llm

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d

Scheduled

Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-h74bt to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-k9sm4 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-p2rlg to ip-10-0-134-58.us-east-2.compute.internal

cert-manager

cert-manager-597b95cb84-7thx5

Scheduled

Successfully assigned cert-manager/cert-manager-597b95cb84-7thx5 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-q656v

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-q656v to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-sgtll to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76 to ip-10-0-134-58.us-east-2.compute.internal

llm

echo-simulator-kserve-64b6f8f96c-qht75

Scheduled

Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-qht75 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-tckhm to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

llm

facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq

Scheduled

Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-7b98bb678c-6hs9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-6hs9t to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp to ip-10-0-134-58.us-east-2.compute.internal

llm

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Scheduled

Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

Scheduled

Successfully assigned openshift-ingress/e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

router-default-59c4cc76f-fbdqx

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-59c4cc76f-fbdqx

FailedScheduling

no nodes available to schedule pods

openshift-ingress

router-default-59c4cc76f-fbdqx

Scheduled

Successfully assigned openshift-ingress/router-default-59c4cc76f-fbdqx to ip-10-0-134-58.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-5c6fc54974-gq9dn

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-5c6fc54974-gq9dn to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-jobset-operator

jobset-controller-manager-757857f55b-rbcqw

Scheduled

Successfully assigned openshift-jobset-operator/jobset-controller-manager-757857f55b-rbcqw to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6 to ip-10-0-137-135.us-east-2.compute.internal

openshift-jobset-operator

jobset-operator-674cd59dc5-fr8r6

Scheduled

Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-fr8r6 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

models-as-a-service

payload-processing-external-model-6bc5d5dd85-4mgzj

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6bc5d5dd85-4mgzj to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

FailedScheduling

0/3 nodes are available: 3 Insufficient cpu. no new claims to deallocate, preemption: 0/3 nodes are available: 3 No preemption victims found for incoming pod.

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t to ip-10-0-134-58.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-6bc5d5dd85-nvgw6

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-6bc5d5dd85-nvgw6 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9982ad-openshift-default-6f478df445-gr62t to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7784e5-openshift-default-564776f9f-zm98k to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf to ip-10-0-134-58.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-849b7688c9-5fxpt

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-849b7688c9-5fxpt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps to ip-10-0-137-135.us-east-2.compute.internal

models-as-a-service

payload-processing-external-model-bc6ff8476-tfpc7

Scheduled

Successfully assigned models-as-a-service/payload-processing-external-model-bc6ff8476-tfpc7 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

Scheduled

Successfully assigned openshift-ingress/e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-7d4ffc574frqzst

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7d4ffc574frqzst to ip-10-0-137-135.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8ff44d5d-wqtwq to ip-10-0-137-135.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8ff44d5d-qk6hc to ip-10-0-134-58.us-east-2.compute.internal

opendatahub-operator-system

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Scheduled

Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-8ff44d5d-nt2zj to ip-10-0-133-96.us-east-2.compute.internal

opendatahub

usage-logs-tenancy-proxy-9c5d49bcd-gx2x5

Scheduled

Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-gx2x5 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7505-7a2b92

Scheduled

Successfully assigned opendatahub/test-curl-7505-7a2b92 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7505-3d0374

Scheduled

Successfully assigned opendatahub/test-curl-7505-3d0374 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7505-297e1b

Scheduled

Successfully assigned opendatahub/test-curl-7505-297e1b to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7505-1eea7e

Scheduled

Successfully assigned opendatahub/test-curl-7505-1eea7e to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

ai-gateway-controller-6c45775ff9-c2ghb

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-6c45775ff9-c2ghb to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7 to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7496-be5069

Scheduled

Successfully assigned opendatahub/test-curl-7496-be5069 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

ai-gateway-controller-7d85675f98-nmwkt

Scheduled

Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-nmwkt to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj to ip-10-0-133-96.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7 to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb to ip-10-0-134-58.us-east-2.compute.internal

openshift-ingress

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7496-a16491

Scheduled

Successfully assigned opendatahub/test-curl-7496-a16491 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7496-2bba09

Scheduled

Successfully assigned opendatahub/test-curl-7496-2bba09 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7496-11401a

Scheduled

Successfully assigned opendatahub/test-curl-7496-11401a to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

test-curl-7493-f4531f

Scheduled

Successfully assigned opendatahub/test-curl-7493-f4531f to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

odh-model-controller-769875db56-lxnnq

Scheduled

Successfully assigned opendatahub/odh-model-controller-769875db56-lxnnq to ip-10-0-137-135.us-east-2.compute.internal

opendatahub

model-serving-api-75bd89fdfc-zjvvq

Scheduled

Successfully assigned opendatahub/model-serving-api-75bd89fdfc-zjvvq to ip-10-0-133-96.us-east-2.compute.internal

opendatahub

maas-controller-8486858879-ttlr5

Scheduled

Successfully assigned opendatahub/maas-controller-8486858879-ttlr5 to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

maas-controller-5dfc4f849f-pjjzp

Scheduled

Successfully assigned opendatahub/maas-controller-5dfc4f849f-pjjzp to ip-10-0-134-58.us-east-2.compute.internal

opendatahub

kserve-controller-manager-776cc66d47-qtvgz

Scheduled

Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-qtvgz to ip-10-0-137-135.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-869d5dcc5d-z4zm5

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-z4zm5 to ip-10-0-133-96.us-east-2.compute.internal

opendatahub

llmisvc-controller-manager-6466c554d8-7gnzw

Scheduled

Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-7gnzw to ip-10-0-133-96.us-east-2.compute.internal

opendatahub

kserve-module-controller-manager-7566cf5fc8-ls657

Scheduled

Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-ls657 to ip-10-0-137-135.us-east-2.compute.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-59c4cc76f from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

replicaset-controller

router-default-59c4cc76f

SuccessfulCreate

Created pod: router-default-59c4cc76f-fbdqx
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x5)

openshift-ingress

kubelet

router-default-59c4cc76f-fbdqx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-59c4cc76f-fbdqx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x3)

openshift-ingress

kubelet

router-default-59c4cc76f-fbdqx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-59c4cc76f-fbdqx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-59c4cc76f-fbdqx

Created

Container created

openshift-ingress

kubelet

router-default-59c4cc76f-fbdqx

Started

Container started

openshift-ingress

kubelet

router-default-59c4cc76f-fbdqx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod

openshift-ingress

multus

router-default-59c4cc76f-fbdqx

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulCreate

Created pod: istiod-openshift-gateway-7876bfcb74-nqdlt

openshift-ingress

multus

istiod-openshift-gateway-7876bfcb74-nqdlt

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nqdlt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nqdlt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.757s (2.757s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nqdlt

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nqdlt

Started

Container started

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-68cb9b4b95 from 0 to 1

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-ai-inference

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-ai-inference-864cbfbb6c from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-ai-inference-864cbfbb6c

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-sgtll

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

service-controller

openshift-ai-inference-openshift-ai-inference

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx

Created

Container created

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.049s (11.049s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-ai-inference-864cbfbb6c-qhbfx

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 11.257s (11.257s including waiting). Image size: 183555333 bytes.

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsNotMet

one or more requirements couldn't be found
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

deployment-controller

opendatahub-operator-controller-manager

ScalingReplicaSet

Scaled up replica set opendatahub-operator-controller-manager-8ff44d5d from 0 to 3

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8ff44d5d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8ff44d5d-wqtwq

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8ff44d5d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8ff44d5d-nt2zj

opendatahub-operator-system

replicaset-controller

opendatahub-operator-controller-manager-8ff44d5d

SuccessfulCreate

Created pod: opendatahub-operator-controller-manager-8ff44d5d-qk6hc

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

opendatahub-operator-system

multus

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

NeedsReinstall

calculated deployment install is bad
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

AllRequirementsMet

all requirements found, attempting install

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Created

Container created
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsNotMet

one or more requirements couldn't be found

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.037s (3.037s including waiting). Image size: 273709574 bytes.
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.967s (2.967s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.853s (2.853s including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 403ms (403ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-nt2zj

Created

Container created

opendatahub-operator-system

opendatahub-operator-controller-manager-8ff44d5d-nt2zj_d6cc1605-42ad-4c70-aac3-de038bebb1b2

07ed84f7.opendatahub.io

LeaderElection

opendatahub-operator-controller-manager-8ff44d5d-nt2zj_d6cc1605-42ad-4c70-aac3-de038bebb1b2 became leader

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-wqtwq

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 374ms (374ms including waiting). Image size: 273709574 bytes.

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

AllRequirementsMet

all requirements found, attempting install

openshift-jobset-operator

replicaset-controller

jobset-operator-674cd59dc5

SuccessfulCreate

Created pod: jobset-operator-674cd59dc5-fr8r6

openshift-jobset-operator

deployment-controller

jobset-operator

ScalingReplicaSet

Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

waiting for install components to report healthy

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Started

Container started

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Created

Container created

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Pulled

Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 499ms (499ms including waiting). Image size: 273709574 bytes.

opendatahub-operator-system

kubelet

opendatahub-operator-controller-manager-8ff44d5d-qk6hc

Pulling

Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
(x2)

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallWaiting

installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

Webhook install failed: conversionWebhook not ready

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fr8r6

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

waiting for install components to report healthy
(x3)

openshift-ingress

horizontal-pod-autoscaler

openshift-ai-inference-openshift-ai-inference

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-jobset-operator

multus

jobset-operator-674cd59dc5-fr8r6

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes
(x2)

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallWaiting

installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
(x2)

opendatahub-operator-system

operator-lifecycle-manager

install-dxxnn

AppliedWithWarnings

1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1

openshift-jobset-operator

operator-lifecycle-manager

jobset-operator.v1.0.1

InstallSucceeded

install strategy completed with no errors

openshift-jobset-operator

openshift-jobset-operator

openshift-jobset-operator-lock

LeaderElection

jobset-operator-674cd59dc5-fr8r6_f58ed525-6134-4984-ac46-deb8d54b60ed became leader

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fr8r6

Started

Container started

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fr8r6

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.986s (2.986s including waiting). Image size: 224874686 bytes.

openshift-jobset-operator

kubelet

jobset-operator-674cd59dc5-fr8r6

Created

Container created

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

opendatahub-operator-system

operator-lifecycle-manager

opendatahub-operator.v3.6.0-ea.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsNotMet

one or more requirements couldn't be found
(x2)

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

kuadrant-operator-controller-manager-cf8469d7b-tftjb

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tftjb

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-cf8469d7b-tftjb

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-cf8469d7b from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

cert-manager

deployment-controller

cert-manager-webhook

ScalingReplicaSet

Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1

cert-manager

replicaset-controller

cert-manager-webhook-5dbbbf75cc

SuccessfulCreate

Created pod: cert-manager-webhook-5dbbbf75cc-cjqh2

cert-manager

multus

cert-manager-webhook-5dbbbf75cc-cjqh2

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cjqh2

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1

kuadrant-system

replicaset-controller

authorino-operator-7b7bb4bc77

SuccessfulCreate

Created pod: authorino-operator-7b7bb4bc77-xwr2j

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tftjb

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tftjb

Started

Container started

kuadrant-system

multus

authorino-operator-7b7bb4bc77-xwr2j

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tftjb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.052s (4.052s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-xwr2j

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cjqh2

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 3.92s (3.92s including waiting). Image size: 309650901 bytes.

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cjqh2

Created

Container created

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cjqh2

Started

Container started

kuadrant-system

kuadrant-operator-controller-manager-cf8469d7b-tftjb_864619a0-e3c6-402a-9969-4a44ceeea5b1

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-cf8469d7b-tftjb_864619a0-e3c6-402a-9969-4a44ceeea5b1 became leader

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1

kuadrant-system

replicaset-controller

dns-operator-controller-manager-8557cbdb84

SuccessfulCreate

Created pod: dns-operator-controller-manager-8557cbdb84-k569b

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-xwr2j

Created

Container created

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-xwr2j

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.717s (1.717s including waiting). Image size: 167738465 bytes.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

authorino-operator-7b7bb4bc77-xwr2j_caccd05e-3a8e-4d5d-8c3a-6ca6b83115b8

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7b7bb4bc77-xwr2j_caccd05e-3a8e-4d5d-8c3a-6ca6b83115b8 became leader

kuadrant-system

kubelet

authorino-operator-7b7bb4bc77-xwr2j

Started

Container started

cert-manager

replicaset-controller

cert-manager-cainjector-5c57bbd4fc

SuccessfulCreate

Created pod: cert-manager-cainjector-5c57bbd4fc-mbp6q

kuadrant-system

multus

dns-operator-controller-manager-8557cbdb84-k569b

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k569b

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

cert-manager

multus

cert-manager-cainjector-5c57bbd4fc-mbp6q

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsUnknown

requirements not yet checked

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-mbp6q

Pulled

Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod

cert-manager

deployment-controller

cert-manager-cainjector

ScalingReplicaSet

Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-66c4fb575d

SuccessfulCreate

Created pod: kuadrant-console-plugin-66c4fb575d-crll9

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

RequirementsNotMet

one or more requirements couldn't be found

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceCreated

Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceAccountCreated

Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-66c4fb575d from 0 to 1

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-mbp6q

Created

Container created

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-7d4ffc574f

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-7d4ffc574frqzst

cert-manager

kubelet

cert-manager-cainjector-5c57bbd4fc-mbp6q

Started

Container started

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-7d4ffc574f from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7d4ffc574frqzst

Created

Container created

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7d4ffc574frqzst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-h9g5s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-7d4ffc574frqzst

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6f89dc687f-bwx2f

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-bwx2f

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-6f89dc687f

SuccessfulCreate

Created pod: kube-auth-proxy-6f89dc687f-bwx2f

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleCreated

Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing

openshift-ingress

replicaset-controller

kube-auth-proxy-6f89dc687f

SuccessfulCreate

Created pod: kube-auth-proxy-6f89dc687f-h9g5s

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6f89dc687f from 0 to 2

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-crll9

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"

kuadrant-system

multus

kuadrant-console-plugin-66c4fb575d-crll9

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ClusterRoleBindingCreated

Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing

openshift-ingress

multus

kube-auth-proxy-6f89dc687f-h9g5s

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-7d4ffc574frqzst

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-5778bb4449

SuccessfulCreate

Created pod: limitador-operator-controller-manager-5778bb4449-w68l9

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

AllRequirementsMet

all requirements found, attempting install

opendatahub

deployment-controller

kserve-module-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1

opendatahub

replicaset-controller

kserve-module-controller-manager-7566cf5fc8

SuccessfulCreate

Created pod: kserve-module-controller-manager-7566cf5fc8-ls657

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls657

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"

opendatahub

multus

kserve-module-controller-manager-7566cf5fc8-ls657

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k569b

Started

Container started

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

ServiceCreated

Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

dns-operator-controller-manager-8557cbdb84-k569b_d6a8131b-c25a-4fb5-8978-24aab06334a2

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-8557cbdb84-k569b_d6a8131b-c25a-4fb5-8978-24aab06334a2 became leader
(x4)

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreateFailed

Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": no endpoints available for service "cert-manager-webhook"

openshift-jobset-operator

openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k569b

Created

Container created

kuadrant-system

kubelet

dns-operator-controller-manager-8557cbdb84-k569b

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 2.782s (2.782s including waiting). Image size: 190804149 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-bwx2f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.349s (2.349s including waiting). Image size: 188904677 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-bwx2f

Created

Container created

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-bwx2f

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-h9g5s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 3.205s (3.205s including waiting). Image size: 188904677 bytes.

kuadrant-system

multus

limitador-operator-controller-manager-5778bb4449-w68l9

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-w68l9

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"

cert-manager

deployment-controller

cert-manager

ScalingReplicaSet

Scaled up replica set cert-manager-597b95cb84 from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-h9g5s

Started

Container started

openshift-ingress

kubelet

kube-auth-proxy-6f89dc687f-h9g5s

Created

Container created

cert-manager

replicaset-controller

cert-manager-597b95cb84

SuccessfulCreate

Created pod: cert-manager-597b95cb84-7thx5

cert-manager

multus

cert-manager-597b95cb84-7thx5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-crll9

Started

Container started

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-w68l9

Created

Container created

cert-manager

kubelet

cert-manager-597b95cb84-7thx5

Pulling

Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-w68l9

Started

Container started

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-crll9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 5.674s (5.674s including waiting). Image size: 342538866 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls657

Started

Container started

kuadrant-system

limitador-operator-controller-manager-5778bb4449-w68l9_2104503c-f51b-44a0-bd25-153718347005

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-5778bb4449-w68l9_2104503c-f51b-44a0-bd25-153718347005 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-5778bb4449-w68l9

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 2.028s (2.028s including waiting). Image size: 177967631 bytes.

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls657

Created

Container created

kuadrant-system

kubelet

kuadrant-console-plugin-66c4fb575d-crll9

Created

Container created

opendatahub

kubelet

kserve-module-controller-manager-7566cf5fc8-ls657

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.462s (2.462s including waiting). Image size: 195729000 bytes.

cert-manager

kubelet

cert-manager-597b95cb84-7thx5

Pulled

Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.817s (2.817s including waiting). Image size: 309650901 bytes.
(x2)

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

waiting for install components to report healthy

cert-manager

kubelet

cert-manager-597b95cb84-7thx5

Started

Container started

cert-manager

kubelet

cert-manager-597b95cb84-7thx5

Created

Container created

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-678d87766f

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-678d87766f-hg8tr

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: deployment changed old hash=6q1WY8Uae4JZmLF4M4Zj2lZF5tKn8wEFi4k5Ve, new hash=88W7Jv6nAXJm3xNFHpPpBPB6INrNa0R4IQ7iYv

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated

kuadrant-system

multus

kuadrant-operator-controller-manager-678d87766f-hg8tr

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hg8tr

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hg8tr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.384s (4.384s including waiting). Image size: 424244516 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hg8tr

Created

Container created

kuadrant-system

kubelet

kuadrant-operator-controller-manager-678d87766f-hg8tr

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.2

InstallSucceeded

install strategy completed with no errors

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

data-science-gateway-data-science-gateway-class

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

opendatahub

kserve-module-controller-manager-7566cf5fc8-ls657_96641f1b-13f0-45eb-bc88-efde9b27541b

kserve-module-controller-manager

LeaderElection

kserve-module-controller-manager-7566cf5fc8-ls657_96641f1b-13f0-45eb-bc88-efde9b27541b became leader

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled down replica set kuadrant-operator-controller-manager-cf8469d7b from 1 to 0

kuadrant-system

kubelet

kuadrant-operator-controller-manager-cf8469d7b-tftjb

Killing

Stopping container manager

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-cf8469d7b

SuccessfulDelete

Deleted pod: kuadrant-operator-controller-manager-cf8469d7b-tftjb

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.3

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kuadrant-operator-controller-manager-678d87766f-hg8tr_b173d5b1-2e84-4b32-95d6-bacf7f3fe624

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-678d87766f-hg8tr_b173d5b1-2e84-4b32-95d6-bacf7f3fe624 became leader

kuadrant-system

multus

limitador-limitador-74dfcfb894-2j9vp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2j9vp

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-7c9b87d574

SuccessfulCreate

Created pod: limitador-limitador-7c9b87d574-d9fgc

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulCreate

Created pod: limitador-limitador-74dfcfb894-2j9vp

kuadrant-system

multus

limitador-limitador-7c9b87d574-d9fgc

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d9fgc

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2j9vp

Created

Container created

kuadrant-system

multus

authorino-56c6c9ddd5-5vlgx

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-56c6c9ddd5-5vlgx

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-57f7f8659f-zt6bv

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulCreate

Created pod: authorino-56c6c9ddd5-5vlgx

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2j9vp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.731s (1.731s including waiting). Image size: 133379307 bytes.

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulCreate

Created pod: authorino-57f7f8659f-zt6bv

kuadrant-system

kubelet

authorino-57f7f8659f-zt6bv

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-57f7f8659f from 0 to 1

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2j9vp

Started

Container started

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-56c6c9ddd5 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d9fgc

Started

Container started

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d9fgc

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.592s (2.592s including waiting). Image size: 133379307 bytes.

kuadrant-system

kubelet

limitador-limitador-7c9b87d574-d9fgc

Created

Container created

kuadrant-system

kubelet

authorino-57f7f8659f-zt6bv

Created

Container created

kuadrant-system

kubelet

authorino-56c6c9ddd5-5vlgx

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-5vlgx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.872s (1.872s including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-57f7f8659f-zt6bv

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.953s (1.953s including waiting). Image size: 204096810 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

authorino-57f7f8659f-zt6bv

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-5vlgx

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

replicaset-controller

authorino-57f7f8659f

SuccessfulDelete

Deleted pod: authorino-57f7f8659f-zt6bv

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-57f7f8659f from 1 to 0

kuadrant-system

kubelet

authorino-57f7f8659f-zt6bv

Killing

Stopping container authorino

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulCreate

Created pod: llmisvc-controller-manager-869d5dcc5d-z4zm5

kuadrant-system

replicaset-controller

limitador-limitador-74dfcfb894

SuccessfulDelete

Deleted pod: limitador-limitador-74dfcfb894-2j9vp

opendatahub

deployment-controller

kserve-controller-manager

ScalingReplicaSet

Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1

opendatahub

replicaset-controller

model-serving-api-75bd89fdfc

SuccessfulCreate

Created pod: model-serving-api-75bd89fdfc-zjvvq

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-rqh7r

opendatahub

replicaset-controller

odh-model-controller-769875db56

SuccessfulCreate

Created pod: odh-model-controller-769875db56-lxnnq

opendatahub

deployment-controller

odh-model-controller

ScalingReplicaSet

Scaled up replica set odh-model-controller-769875db56 from 0 to 1

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-z4zm5

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

multus

llmisvc-controller-manager-869d5dcc5d-z4zm5

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

opendatahub

multus

kserve-controller-manager-776cc66d47-qtvgz

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

opendatahub

kubelet

model-serving-api-75bd89fdfc-zjvvq

Pulling

Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"

opendatahub

replicaset-controller

kserve-controller-manager-776cc66d47

SuccessfulCreate

Created pod: kserve-controller-manager-776cc66d47-qtvgz

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1

opendatahub

multus

model-serving-api-75bd89fdfc-zjvvq

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-74dfcfb894-2j9vp

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0

opendatahub

deployment-controller

model-serving-api

ScalingReplicaSet

Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qtvgz

Pulling

Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"

opendatahub

kubelet

odh-model-controller-769875db56-lxnnq

Pulling

Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"

opendatahub

multus

odh-model-controller-769875db56-lxnnq

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-rqh7r

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rqh7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rqh7r

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-rqh7r

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7876bfcb74-nqdlt

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7876bfcb74

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7876bfcb74-nqdlt

opendatahub

kubelet

model-serving-api-75bd89fdfc-zjvvq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.928s (1.928s including waiting). Image size: 184925761 bytes.

opendatahub

kubelet

model-serving-api-75bd89fdfc-zjvvq

Created

Container created

opendatahub

kubelet

model-serving-api-75bd89fdfc-zjvvq

Started

Container started

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0

opendatahub

kubelet

odh-model-controller-769875db56-lxnnq

Started

Container started

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qtvgz

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-lxnnq

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-z4zm5

Started

Container started

opendatahub

kubelet

odh-model-controller-769875db56-lxnnq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 2.821s (2.821s including waiting). Image size: 236755567 bytes.

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-z4zm5

Created

Container created

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-z4zm5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 2.287s (2.287s including waiting). Image size: 235100981 bytes.

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qtvgz

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.354s (2.354s including waiting). Image size: 247676581 bytes.

opendatahub

kserve-controller-manager-776cc66d47-qtvgz_9e40e219-0a4e-4c35-a470-5b4f50e442c4

kserve-controller-manager-leader-lock

LeaderElection

kserve-controller-manager-776cc66d47-qtvgz_9e40e219-0a4e-4c35-a470-5b4f50e442c4 became leader

opendatahub

odh-model-controller-769875db56-lxnnq_2cce3440-6565-43fb-9024-56f2dff87cb7

odh-model-controller.opendatahub.io

LeaderElection

odh-model-controller-769875db56-lxnnq_2cce3440-6565-43fb-9024-56f2dff87cb7 became leader

opendatahub

kubelet

kserve-controller-manager-776cc66d47-qtvgz

Created

Container created

opendatahub

llmisvc-controller-manager-869d5dcc5d-z4zm5_5852667d-9db3-4a26-b8b2-14666eb811ce

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-869d5dcc5d-z4zm5_5852667d-9db3-4a26-b8b2-14666eb811ce became leader

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-serving-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-serving-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-serving-cert

Generated

Stored new private key in temporary Secret resource "jobset-serving-cert-2tq8r"

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-serving-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

IssuerCreated

Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-trigger

jobset-metrics-cert

Issuing

Issuing certificate as Secret does not exist

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CertificateCreated

Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-serving-cert

Requested

Created new CertificateRequest resource "jobset-serving-cert-1"

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-serving-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-serving-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

CustomResourceDefinitionCreated

Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing

openshift-jobset-operator

cert-manager-certificaterequests-issuer-acme

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationCreated

Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationCreated

Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing

openshift-jobset-operator

cert-manager-certificates-issuing

jobset-metrics-cert

Issuing

The certificate has been successfully issued

openshift-jobset-operator

cert-manager-certificates-request-manager

jobset-metrics-cert

Requested

Created new CertificateRequest resource "jobset-metrics-cert-1"

openshift-jobset-operator

cert-manager-certificates-key-manager

jobset-metrics-cert

Generated

Stored new private key in temporary Secret resource "jobset-metrics-cert-qz6dg"

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-selfsigned

jobset-metrics-cert-1

CertificateIssued

Certificate fetched from issuer successfully

openshift-jobset-operator

cert-manager-certificaterequests-approver

jobset-metrics-cert-1

cert-manager.io

Certificate request has been approved by cert-manager.io

openshift-jobset-operator

cert-manager-certificaterequests-issuer-venafi

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-vault

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

cert-manager-certificaterequests-issuer-ca

jobset-metrics-cert-1

WaitingForApproval

Not signing CertificateRequest until it is Approved

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleCreated

Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ServiceMonitorCreated

Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing

openshift-jobset-operator

deployment-controller

jobset-controller-manager

ScalingReplicaSet

Scaled up replica set jobset-controller-manager-757857f55b from 0 to 1

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

RoleBindingCreated

Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

DeploymentCreated

Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ConfigMapCreated

Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

ValidatingWebhookConfigurationUpdated

Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed

openshift-jobset-operator

openshift-jobset-operator

jobset-operator

MutatingWebhookConfigurationUpdated

Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed

openshift-jobset-operator

replicaset-controller

jobset-controller-manager-757857f55b

SuccessfulCreate

Created pod: jobset-controller-manager-757857f55b-rbcqw

openshift-jobset-operator

multus

jobset-controller-manager-757857f55b-rbcqw

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-jobset-operator

kubelet

jobset-controller-manager-757857f55b-rbcqw

Pulling

Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"

openshift-jobset-operator

kubelet

jobset-controller-manager-757857f55b-rbcqw

Started

Container started

openshift-jobset-operator

kubelet

jobset-controller-manager-757857f55b-rbcqw

Created

Container created

openshift-jobset-operator

kubelet

jobset-controller-manager-757857f55b-rbcqw

Pulled

Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 2.918s (2.918s including waiting). Image size: 182184678 bytes.

openshift-jobset-operator

jobset-controller-manager-757857f55b-rbcqw_e5cbb4e4-b7b9-4924-b0fb-bd46b9d31801

6d4f6a47.jobset.x-k8s.io

LeaderElection

jobset-controller-manager-757857f55b-rbcqw_e5cbb4e4-b7b9-4924-b0fb-bd46b9d31801 became leader

opendatahub

replicaset-controller

maas-controller-5dfc4f849f

SuccessfulCreate

Created pod: maas-controller-5dfc4f849f-pjjzp

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-5dfc4f849f from 0 to 1

opendatahub

multus

maas-controller-8486858879-ttlr5

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-8486858879-ttlr5

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:63e7a3120d5d5aad765a15bd472e393f162f955e00ae3af7ef9aac7dd0ad0275"

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled up replica set maas-controller-8486858879 from 0 to 1

opendatahub

kubelet

maas-controller-5dfc4f849f-pjjzp

Pulling

Pulling image "quay.io/opendatahub/maas-controller@sha256:63e7a3120d5d5aad765a15bd472e393f162f955e00ae3af7ef9aac7dd0ad0275"

opendatahub

replicaset-controller

maas-controller-8486858879

SuccessfulCreate

Created pod: maas-controller-8486858879-ttlr5

opendatahub

multus

maas-controller-5dfc4f849f-pjjzp

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

opendatahub

kubelet

maas-controller-8486858879-ttlr5

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:63e7a3120d5d5aad765a15bd472e393f162f955e00ae3af7ef9aac7dd0ad0275" in 3.371s (3.371s including waiting). Image size: 200094736 bytes.

opendatahub

kubelet

maas-controller-5dfc4f849f-pjjzp

Started

Container started

opendatahub

kubelet

maas-controller-8486858879-ttlr5

Started

Container started

opendatahub

kubelet

maas-controller-8486858879-ttlr5

Created

Container created

opendatahub

kubelet

maas-controller-5dfc4f849f-pjjzp

Pulled

Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:63e7a3120d5d5aad765a15bd472e393f162f955e00ae3af7ef9aac7dd0ad0275" in 3.87s (3.87s including waiting). Image size: 200094736 bytes.

opendatahub

kubelet

maas-controller-5dfc4f849f-pjjzp

Created

Container created

opendatahub

maas-controller-5dfc4f849f-pjjzp_06b8e3e1-7ec9-48a8-b63e-45e16cf0c5db

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-5dfc4f849f-pjjzp_06b8e3e1-7ec9-48a8-b63e-45e16cf0c5db became leader

opendatahub

deployment-controller

usage-logs-tenancy-proxy

ScalingReplicaSet

Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1

opendatahub

replicaset-controller

usage-logs-tenancy-proxy-9c5d49bcd

SuccessfulCreate

Created pod: usage-logs-tenancy-proxy-9c5d49bcd-gx2x5

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gx2x5

Pulling

Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"

opendatahub

multus

usage-logs-tenancy-proxy-9c5d49bcd-gx2x5

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

maas-controller-5dfc4f849f-pjjzp

Killing

Stopping container manager

opendatahub

replicaset-controller

maas-controller-5dfc4f849f

SuccessfulDelete

Deleted pod: maas-controller-5dfc4f849f-pjjzp

opendatahub

deployment-controller

maas-controller

ScalingReplicaSet

Scaled down replica set maas-controller-5dfc4f849f from 1 to 0

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gx2x5

Pulled

Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 11.498s (11.498s including waiting). Image size: 1089502687 bytes.

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gx2x5

Created

Container created

opendatahub

kubelet

usage-logs-tenancy-proxy-9c5d49bcd-gx2x5

Started

Container started

opendatahub

maas-controller-8486858879-ttlr5_b4ae0da8-059b-446f-bc82-80010f49ef05

maas-controller.models-as-a-service.opendatahub.io

LeaderElection

maas-controller-8486858879-ttlr5_b4ae0da8-059b-446f-bc82-80010f49ef05 became leader

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulDelete

Deleted pod: authorino-6dd76875b5-l9ndj

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6dd76875b5 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6dd76875b5

SuccessfulCreate

Created pod: authorino-6dd76875b5-l9ndj
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Created

Container created

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulCreate

Created pod: authorino-6889cbd8c4-wzs5x
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6889cbd8c4 from 0 to 1

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6dd76875b5 from 1 to 0

kuadrant-system

kubelet

authorino-6867c46776-hlcsj

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

multus

authorino-6867c46776-hlcsj

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6889cbd8c4-wzs5x

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-6889cbd8c4 from 1 to 0

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-6867c46776 from 0 to 1

kuadrant-system

replicaset-controller

authorino-6889cbd8c4

SuccessfulDelete

Deleted pod: authorino-6889cbd8c4-wzs5x

kuadrant-system

replicaset-controller

authorino-6867c46776

SuccessfulCreate

Created pod: authorino-6867c46776-hlcsj

kuadrant-system

multus

authorino-6889cbd8c4-wzs5x

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-6867c46776-hlcsj

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 580ms (580ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-wzs5x

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 875ms (875ms including waiting). Image size: 204096810 bytes.

kuadrant-system

kubelet

authorino-6889cbd8c4-wzs5x

Started

Container started

kuadrant-system

kubelet

authorino-6889cbd8c4-wzs5x

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

kuadrant-system

kubelet

authorino-6867c46776-hlcsj

Created

Container created

kuadrant-system

kubelet

authorino-6867c46776-hlcsj

Started

Container started

kuadrant-system

kubelet

authorino-56c6c9ddd5-5vlgx

Killing

Stopping container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-56c6c9ddd5 from 1 to 0

kuadrant-system

replicaset-controller

authorino-56c6c9ddd5

SuccessfulDelete

Deleted pod: authorino-56c6c9ddd5-5vlgx

kuadrant-system

kubelet

authorino-6889cbd8c4-wzs5x

Killing

Stopping container authorino

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7gnzw

Pulling

Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"

opendatahub

replicaset-controller

llmisvc-controller-manager-6466c554d8

SuccessfulCreate

Created pod: llmisvc-controller-manager-6466c554d8-7gnzw

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1

opendatahub

multus

llmisvc-controller-manager-6466c554d8-7gnzw

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

ProbeError

Startup probe error: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused body:

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7gnzw

Started

Container started

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7gnzw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 349ms (349ms including waiting). Image size: 235100981 bytes.
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Unhealthy

Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused

opendatahub

kubelet

llmisvc-controller-manager-6466c554d8-7gnzw

Created

Container created
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

replicaset-controller

llmisvc-controller-manager-869d5dcc5d

SuccessfulDelete

Deleted pod: llmisvc-controller-manager-869d5dcc5d-z4zm5

opendatahub

deployment-controller

llmisvc-controller-manager

ScalingReplicaSet

Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0

opendatahub

kubelet

llmisvc-controller-manager-869d5dcc5d-z4zm5

Killing

Stopping container manager

opendatahub

kubelet

ai-gateway-controller-7d85675f98-nmwkt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

multus

ai-gateway-controller-7d85675f98-nmwkt

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulCreate

Created pod: ai-gateway-controller-7d85675f98-nmwkt

opendatahub

kubelet

ai-gateway-controller-7d85675f98-nmwkt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.498s (1.498s including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-7d85675f98-nmwkt

Created

Container created

opendatahub

kubelet

ai-gateway-controller-7d85675f98-nmwkt

Started

Container started

opendatahub

ai-gateway-controller-7d85675f98-nmwkt_be041b1b-df70-4f1a-91dc-c2cb1dd04cd7

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-7d85675f98-nmwkt_be041b1b-df70-4f1a-91dc-c2cb1dd04cd7 became leader

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5f78687d5b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

FailedCreate

Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5f78687d5b

SuccessfulCreate

Created pod: payload-processing-5f78687d5b-vfsrt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

FailedCreate

Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-7b98bb678c

SuccessfulCreate

Created pod: payload-pre-processing-7b98bb678c-6hs9t

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1

openshift-ingress

multus

payload-processing-5f78687d5b-vfsrt

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-7b98bb678c-6hs9t

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5f78687d5b-vfsrt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6hs9t

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6hs9t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.242s (2.242s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6hs9t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-7b98bb678c-6hs9t

Created

Container created

openshift-ingress

kubelet

payload-processing-5f78687d5b-vfsrt

Started

Container started

openshift-ingress

kubelet

payload-processing-5f78687d5b-vfsrt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.223s (2.223s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-5f78687d5b-vfsrt

Created

Container created

opendatahub

kubelet

ai-gateway-controller-6c45775ff9-c2ghb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled up replica set ai-gateway-controller-6c45775ff9 from 0 to 1

opendatahub

replicaset-controller

ai-gateway-controller-6c45775ff9

SuccessfulCreate

Created pod: ai-gateway-controller-6c45775ff9-c2ghb

opendatahub

multus

ai-gateway-controller-6c45775ff9-c2ghb

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

opendatahub

kubelet

ai-gateway-controller-6c45775ff9-c2ghb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 471ms (471ms including waiting). Image size: 183926184 bytes.

opendatahub

kubelet

ai-gateway-controller-6c45775ff9-c2ghb

Started

Container started

opendatahub

kubelet

ai-gateway-controller-6c45775ff9-c2ghb

Created

Container created

opendatahub

llmisvc-controller-manager-6466c554d8-7gnzw_1cdb4073-3080-42b7-a5ba-b4b57ab50257

llminferenceservice-kserve-controller-manager

LeaderElection

llmisvc-controller-manager-6466c554d8-7gnzw_1cdb4073-3080-42b7-a5ba-b4b57ab50257 became leader

opendatahub

deployment-controller

ai-gateway-controller

ScalingReplicaSet

Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0

opendatahub

kubelet

ai-gateway-controller-7d85675f98-nmwkt

Killing

Stopping container manager

opendatahub

replicaset-controller

ai-gateway-controller-7d85675f98

SuccessfulDelete

Deleted pod: ai-gateway-controller-7d85675f98-nmwkt

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Deployment llm/e2e-distinct-2-simulated-kserve

llm

deployment-controller

e2e-distinct-2-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1

llm

replicaset-controller

e2e-distinct-2-simulated-kserve-cbd4f5586

SuccessfulCreate

Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj

llm

multus

e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.801s (1.801s including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj

Created

Container created

llm

kubelet

e2e-distinct-2-simulated-kserve-cbd4f5586-kpwlj

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zgw99

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

e2e-distinct-simulated-kserve-7b998b79d9-zgw99

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

llm

replicaset-controller

e2e-distinct-simulated-kserve-7b998b79d9

SuccessfulCreate

Created pod: e2e-distinct-simulated-kserve-7b998b79d9-zgw99

llm

deployment-controller

e2e-distinct-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Deployment llm/e2e-distinct-simulated-kserve

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-distinct-simulated

Created

Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zgw99

Started

Container started

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zgw99

Created

Container created

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zgw99

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.27s (1.27s including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Deployment llm/e2e-embedding-simulated-kserve

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc

llm

replicaset-controller

e2e-embedding-simulated-kserve-67bf594cd6

SuccessfulCreate

Created pod: e2e-embedding-simulated-kserve-67bf594cd6-68f2m

llm

deployment-controller

e2e-embedding-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1

llm

multus

e2e-embedding-simulated-kserve-67bf594cd6-68f2m

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-68f2m

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Deployment llm/e2e-trlp-test-simulated-kserve

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

deployment-controller

e2e-trlp-test-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1

llm

replicaset-controller

e2e-trlp-test-simulated-kserve-69b588897d

SuccessfulCreate

Created pod: e2e-trlp-test-simulated-kserve-69b588897d-npxnt

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-embedding-simulated

Created

Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-npxnt

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-68f2m

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 286ms (286ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve

llm

replicaset-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc

SuccessfulCreate

Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Created

Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping

llm

deployment-controller

e2e-unconfigured-facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

multus

e2e-trlp-test-simulated-kserve-69b588897d-npxnt

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-npxnt

Created

Container created

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-npxnt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-68f2m

Started

Container started

llm

kubelet

e2e-embedding-simulated-kserve-67bf594cd6-68f2m

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc

llm

kubelet

e2e-trlp-test-simulated-kserve-69b588897d-npxnt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 276ms (276ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 305ms (305ms including waiting). Image size: 98346788 bytes.

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d

Created

Container created

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d

Started

Container started

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default

llm

multus

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine

llm

kubelet

e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8fh28d

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.HTTPRoute llm/echo-simulator-kserve-route

llm

deployment-controller

echo-simulator-kserve

ScalingReplicaSet

Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping

llm

replicaset-controller

echo-simulator-kserve-64b6f8f96c

SuccessfulCreate

Created pod: echo-simulator-kserve-64b6f8f96c-qht75

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Service llm/echo-simulator-kserve-workload-svc

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.Deployment llm/echo-simulator-kserve

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

echo-simulator

Created

Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine

llm

multus

facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

llm

replicaset-controller

premium-simulated-simulated-premium-kserve-5f5c4b459f

SuccessfulCreate

Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

multus

echo-simulator-kserve-64b6f8f96c-qht75

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping

llm

deployment-controller

premium-simulated-simulated-premium-kserve

ScalingReplicaSet

Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Deployment llm/premium-simulated-simulated-premium-kserve

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qht75

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 312ms (312ms including waiting). Image size: 98346788 bytes.

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine

llm

replicaset-controller

facebook-opt-125m-simulated-kserve-84b4ff656c

SuccessfulCreate

Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Created

Created v1.Deployment llm/facebook-opt-125m-simulated-kserve

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Created

Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc

llm

deployment-controller

facebook-opt-125m-simulated-kserve

ScalingReplicaSet

Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Created

Container created
(x2)

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

Updated

Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qht75

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.872s (1.872s including waiting). Image size: 78208878 bytes.

llm

LLMInferenceServiceController

e2e-distinct-2-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-2-simulated] is Ready

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qht75

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Started

Container started

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 313ms (313ms including waiting). Image size: 98346788 bytes.

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq

Started

Container started

llm

kubelet

facebook-opt-125m-simulated-kserve-84b4ff656c-nmscq

Created

Container created

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

llm

multus

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qht75

Started

Container started

llm

LLMInferenceServiceController

e2e-distinct-simulated

Updated

Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-embedding-simulated

Updated

Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs

opendatahub

ai-gateway-controller-6c45775ff9-c2ghb_6528c438-f231-499f-9d06-b6d4f0abed33

ai-gateway-controller-leader.opendatahub.io

LeaderElection

ai-gateway-controller-6c45775ff9-c2ghb_6528c438-f231-499f-9d06-b6d4f0abed33 became leader

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

Updated

Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

Updated

Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs

llm

LLMInferenceServiceController

echo-simulator

Updated

Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

Updated

Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs

llm

LLMInferenceServiceController

e2e-trlp-test-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-trlp-test-simulated] is Ready

llm

LLMInferenceServiceController

e2e-embedding-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-embedding-simulated] is Ready

llm

LLMInferenceServiceController

e2e-distinct-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-distinct-simulated] is Ready

llm

LLMInferenceServiceController

e2e-unconfigured-facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-78fkg

llm

LLMInferenceServiceController

echo-simulator

LLMInferenceServiceReady

LLMInferenceService [echo-simulator] is Ready

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-68cb9b4b95 from 1 to 4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-dhclt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

llm

LLMInferenceServiceController

facebook-opt-125m-simulated

LLMInferenceServiceReady

LLMInferenceService [facebook-opt-125m-simulated] is Ready

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

llm

LLMInferenceServiceController

premium-simulated-simulated-premium

LLMInferenceServiceReady

LLMInferenceService [premium-simulated-simulated-premium] is Ready

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-58966b5867

SuccessfulCreate

Created pod: authorino-58966b5867-lsc7q

kuadrant-system

multus

authorino-58966b5867-lsc7q

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-58966b5867-lsc7q

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

Started

Container started

kuadrant-system

kubelet

authorino-58966b5867-lsc7q

Started

Container started
(x2)

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

(combined from similar events): Scaled down replica set authorino-6867c46776 from 1 to 0

kuadrant-system

replicaset-controller

authorino-6867c46776

SuccessfulDelete

Deleted pod: authorino-6867c46776-hlcsj

kuadrant-system

kubelet

authorino-6867c46776-hlcsj

Killing

Stopping container authorino

kuadrant-system

kubelet

authorino-58966b5867-lsc7q

Created

Container created

kuadrant-system

kubelet

authorino-58966b5867-lsc7q

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.019s (1.019s including waiting). Image size: 204096810 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.291s (3.291s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.451s (3.451s including waiting). Image size: 183555333 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

Created

Container created
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-78fkg

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ait-226ecbcb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-226ecbcb-openshift-default-76b598d4f5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-226ecbcb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-226ecbcb

openshift-ingress

replicaset-controller

e2e-ait-226ecbcb-openshift-default-76b598d4f5

SuccessfulCreate

Created pod: e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

openshift-ingress

gateway_labeler_controller

e2e-migrate-6156d5d6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-6156d5d6-gw

openshift-ingress

replicaset-controller

e2e-ait-e4242163-openshift-default-7548d57fc9

SuccessfulCreate

Created pod: e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

openshift-ingress

deployment-controller

e2e-ait-e4242163-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e4242163-openshift-default-7548d57fc9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f

SuccessfulCreate

Created pod: e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

openshift-ingress

deployment-controller

e2e-migrate-6156d5d6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-e4242163

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e4242163

openshift-ingress

multus

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-ee87bf29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ee87bf29

openshift-ingress

deployment-controller

e2e-ait-ee87bf29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ee87bf29-openshift-default-7d64c658c7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-ee87bf29-openshift-default-7d64c658c7

SuccessfulCreate

Created pod: e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

openshift-ingress

multus

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6156d5d6-fb57cdc98

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-6156d5d6-fb57cdc98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6156d5d6: serviceaccount "payload-processing-e2e-migrate-6156d5d6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-6156d5d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-6156d5d6-fb57cdc98 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6156d5d6: serviceaccount "payload-processing-e2e-migrate-6156d5d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-6156d5d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-226ecbcb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-226ecbcb-69b85788bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-226ecbcb-5d69cc78dd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-226ecbcb-5d69cc78dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-226ecbcb: serviceaccount "payload-processing-e2e-ait-226ecbcb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

openshift-ingress

multus

payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6156d5d6-fb57cdc98

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

openshift-ingress

multus

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-226ecbcb: serviceaccount "payload-processing-e2e-ait-226ecbcb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-226ecbcb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-226ecbcb-5d69cc78dd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e4242163-d74b5477f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e4242163-d74b5477f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e4242163: serviceaccount "payload-processing-e2e-ait-e4242163" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-226ecbcb-5d69cc78dd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

openshift-ingress

kubelet

payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e4242163-d74b5477f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

openshift-ingress

multus

payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e4242163

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e4242163-d74b5477f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ee87bf29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ee87bf29-6fbff56fcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e4242163

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e4242163-6fddb59d56 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ee87bf29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e4242163-6fddb59d56

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e4242163-6fddb59d56

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e4242163-6fddb59d56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e4242163: serviceaccount "payload-processing-e2e-ait-e4242163" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ee87bf29: serviceaccount "payload-processing-e2e-ait-ee87bf29" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ee87bf29-6fbff56fcd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ee87bf29-6fbff56fcd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ee87bf29-6fbff56fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ee87bf29: serviceaccount "payload-processing-e2e-ait-ee87bf29" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.215s (2.215s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 408ms (408ms including waiting). Image size: 125353965 bytes.

openshift-ingress

deployment-controller

e2e-derive-f951dfa9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f951dfa9-openshift-default-5ddd96b597 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f951dfa9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f951dfa9

openshift-ingress

kubelet

payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.563s (2.563s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf

Created

Container created

openshift-ingress

replicaset-controller

e2e-derive-f951dfa9-openshift-default-5ddd96b597

SuccessfulCreate

Created pod: e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.43s (2.43s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.845s (3.845s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.781s (3.781s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.79s (3.79s including waiting). Image size: 125353965 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.299s (2.299s including waiting). Image size: 125353965 bytes.

openshift-ingress

multus

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f951dfa9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f951dfa9-57f46fd8db

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f951dfa9-57f46fd8db

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f951dfa9-57f46fd8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f951dfa9: serviceaccount "payload-processing-e2e-derive-f951dfa9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f951dfa9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f951dfa9-57f46fd8db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f951dfa9: serviceaccount "payload-processing-e2e-derive-f951dfa9" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2

Started

Container started

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-f951dfa9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-derive-f951dfa9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-6156d5d6-fb57cdc98-7bh9t

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6156d5d6-55fcbb8767-4w5g4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-226ecbcb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-226ecbcb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-6156d5d6-gw-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-migrate-6156d5d6-gw-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e4242163-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-e4242163-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ee87bf29-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ait-ee87bf29-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-6156d5d6-gw-openshift-default-7469cb758f-v924s

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-2889dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-2889dd

openshift-ingress

kubelet

payload-processing-e2e-ait-e4242163-6fddb59d56-jvvtf

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-226ecbcb-69b85788bc-8xszf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e4242163-d74b5477f-fwc2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-226ecbcb-5d69cc78dd-rjzsb

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ee87bf29-5dbc87966c-x9gwt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ee87bf29-6fbff56fcd-jdszn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-226ecbcb-openshift-default-76b598d4f5-rw84q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f951dfa9-64fb47cdc-pffp2

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-f951dfa9-57f46fd8db-pvmwf

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

openshift-ingress

kubelet

e2e-ait-ee87bf29-openshift-default-7d64c658c7-bqm5k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-worker-w2-39bde3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-39bde3

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-2889dd: serviceaccount "payload-processing-e2e-worker-w3-2889dd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-2889dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-2889dd-6f44c5c46b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-2889dd: serviceaccount "payload-processing-e2e-worker-w3-2889dd" not found

openshift-ingress

kubelet

e2e-ait-e4242163-openshift-default-7548d57fc9-fxb8h

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-9de872

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-9de872

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-2889dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

openshift-ingress

multus

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulCreate

Created pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-0458df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-0458df

openshift-ingress

kubelet

e2e-derive-f951dfa9-openshift-default-5ddd96b597-dzjdp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

Started

Container started

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-worker-w1-85cb41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-85cb41

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-39bde3: serviceaccount "payload-processing-e2e-worker-w2-39bde3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-39bde3-79487f87d

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w2-39bde3-79487f87d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-39bde3: serviceaccount "payload-processing-e2e-worker-w2-39bde3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w2-39bde3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w2-39bde3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w2-39bde3-79487f87d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w2-39bde3-79487f87d

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-9de872: serviceaccount "payload-processing-e2e-worker-w0-9de872" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-9de872-7f6d476d96

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-9de872-7f6d476d96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-9de872: serviceaccount "payload-processing-e2e-worker-w0-9de872" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-9de872-7f6d476d96

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-9de872

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-9de872-7f6d476d96 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-9de872

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-9de872-667c8d977f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-0458df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-0458df-59fd997f55 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-0458df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-0458df-8458bc48d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-0458df-8458bc48d8

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-0458df-8458bc48d8

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-0458df-8458bc48d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-0458df: serviceaccount "payload-processing-e2e-worker-w4-0458df" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-0458df: serviceaccount "payload-processing-e2e-worker-w4-0458df" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

Started

Container started

openshift-ingress

multus

payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-85cb41-558557d48b

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w1-85cb41-558557d48b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-85cb41: serviceaccount "payload-processing-e2e-worker-w1-85cb41" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w1-85cb41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w1-85cb41-558557d48b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

Created

Container created

openshift-ingress

multus

payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-85cb41: serviceaccount "payload-processing-e2e-worker-w1-85cb41" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w1-85cb41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w1-85cb41-68854975f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w1-85cb41-558557d48b

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:56196->10.132.0.53:15021: read: connection reset by peer body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:56196->10.132.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

Started

Container started
(x5)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x5)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 1 to 2
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 1 to 2

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulCreate

Created pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

replicaset-controller

payload-processing-external-model-5c6fc54974

SuccessfulCreate

Created pod: payload-processing-external-model-5c6fc54974-gq9dn
(x4)

models-as-a-service

replicaset-controller

payload-processing-external-model-5c6fc54974

FailedCreate

Error creating: pods "payload-processing-external-model-5c6fc54974-" is forbidden: error looking up service account models-as-a-service/payload-processing-external-model: serviceaccount "payload-processing-external-model" not found

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-5c6fc54974 from 0 to 1

models-as-a-service

kubelet

payload-processing-external-model-5c6fc54974-gq9dn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-5c6fc54974-gq9dn

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-5c6fc54974-gq9dn

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-5c6fc54974-gq9dn

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-849b7688c9 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

Unhealthy

Readiness probe failed: Get "http://10.133.0.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-sgtll

ProbeError

Readiness probe error: Get "http://10.133.0.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

models-as-a-service

replicaset-controller

payload-processing-external-model-849b7688c9

SuccessfulCreate

Created pod: payload-processing-external-model-849b7688c9-5fxpt

models-as-a-service

kubelet

payload-processing-external-model-849b7688c9-5fxpt

Created

Container created

models-as-a-service

multus

payload-processing-external-model-849b7688c9-5fxpt

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-849b7688c9-5fxpt

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-849b7688c9-5fxpt

Started

Container started

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-849b7688c9 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-849b7688c9-5fxpt

Killing

Stopping container payload-processing

models-as-a-service

replicaset-controller

payload-processing-external-model-6bc5d5dd85

SuccessfulCreate

Created pod: payload-processing-external-model-6bc5d5dd85-4mgzj

models-as-a-service

replicaset-controller

payload-processing-external-model-849b7688c9

SuccessfulDelete

Deleted pod: payload-processing-external-model-849b7688c9-5fxpt

models-as-a-service

multus

payload-processing-external-model-6bc5d5dd85-4mgzj

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-4mgzj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-4mgzj

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-4mgzj

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 2 to 3

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

Started

Container started

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 2 to 4

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-68cb9b4b95 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-tckhm

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

Created

Container created

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 2 to 4

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

Started

Container started

models-as-a-service

replicaset-controller

payload-processing-external-model-5c6fc54974

SuccessfulDelete

Deleted pod: payload-processing-external-model-5c6fc54974-gq9dn

models-as-a-service

kubelet

payload-processing-external-model-5c6fc54974-gq9dn

Killing

Stopping container payload-processing

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-5c6fc54974 from 1 to 0
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x10)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-p2rlg

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-q656v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-q656v

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-q656v

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

Created

Container created

openshift-ingress

multus

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

Created

Container created

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

Started

Container started

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-q656v

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 5; reason:

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 4 to 5

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

(combined from similar events): Created pod: maas-default-gateway-openshift-default-68cb9b4b95-h74bt

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-68cb9b4b95-q656v

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-68cb9b4b95 from 8 to 10

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-bc6ff8476 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-bc6ff8476

SuccessfulCreate

Created pod: payload-processing-external-model-bc6ff8476-tfpc7

models-as-a-service

multus

payload-processing-external-model-bc6ff8476-tfpc7

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

models-as-a-service

kubelet

payload-processing-external-model-bc6ff8476-tfpc7

Started

Container started

models-as-a-service

kubelet

payload-processing-external-model-bc6ff8476-tfpc7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-bc6ff8476-tfpc7

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

ProbeError

Startup probe error: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

Unhealthy

Startup probe failed: Get "http://10.133.0.85:15021/healthz/ready": dial tcp 10.133.0.85:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-q656v

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-q656v

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-q656v

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-q656v

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-bkpg7

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-tckhm

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

models-as-a-service

replicaset-controller

payload-processing-external-model-6bc5d5dd85

SuccessfulDelete

Deleted pod: payload-processing-external-model-6bc5d5dd85-4mgzj

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled down replica set payload-processing-external-model-6bc5d5dd85 from 1 to 0

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-4mgzj

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 3 to 6

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-hncld

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-hncld

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hncld

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

Created

Container created

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hncld

Started

Container started

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hncld

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.707s (3.707s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-hncld

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 7; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 4 to 7

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 6 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

models-as-a-service

deployment-controller

payload-processing-external-model

ScalingReplicaSet

Scaled up replica set payload-processing-external-model-6bc5d5dd85 from 0 to 1

models-as-a-service

replicaset-controller

payload-processing-external-model-6bc5d5dd85

SuccessfulCreate

Created pod: payload-processing-external-model-6bc5d5dd85-nvgw6

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 6; reason: cpu resource utilization (percentage of request) above target

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-nvgw6

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

Started

Container started

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 5 to 6

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-nvgw6

Created

Container created

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-nvgw6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

models-as-a-service

multus

payload-processing-external-model-6bc5d5dd85-nvgw6

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

models-as-a-service

kubelet

payload-processing-external-model-6bc5d5dd85-nvgw6

Killing

Stopping container payload-processing

models-as-a-service

kubelet

payload-processing-external-model-bc6ff8476-tfpc7

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 6 to 10

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

Started

Container started

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

Created

Container created

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 7 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 9; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

Started

Container started

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 8 to 10
(x6)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

Started

Container started

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

Started

Container started

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 9 to 10

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Unhealthy

Readiness probe failed: Get "https://10.133.0.47:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": dial tcp 10.133.0.104:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

ProbeError

Startup probe error: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

Unhealthy

Startup probe failed: Get "http://10.133.0.104:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x11)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x11)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 2 to 4

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Started

Container started

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

Created

Container created

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Unhealthy

Readiness probe failed: Get "https://10.133.0.47:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

ProbeError

Readiness probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Unhealthy

Readiness probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 5; reason:
(x3)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 4 to 5

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 2 to 3

openshift-ingress

multus

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulCreate

Created pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

AddedInterface

Add eth0 [10.133.0.115/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-f37d42

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-f37d42

openshift-ingress

replicaset-controller

e2e-api-a-f37d42-openshift-default-7645c57f7c

SuccessfulCreate

Created pod: e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

openshift-ingress

deployment-controller

e2e-api-a-f37d42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f37d42-openshift-default-7645c57f7c from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-87293f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-87293f

openshift-ingress

deployment-controller

e2e-api-a-87293f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-87293f-openshift-default-7c9c9cbc7f from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-a-87293f-openshift-default-7c9c9cbc7f

SuccessfulCreate

Created pod: e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

openshift-ingress

multus

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

AddedInterface

Add eth0 [10.133.0.116/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

ProbeError

Startup probe error: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

Unhealthy

Startup probe failed: Get "http://10.133.0.115:15021/healthz/ready": dial tcp 10.133.0.115:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-f37d42

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-f37d42-78585ddd78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f37d42-78585ddd78

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-f37d42

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-f37d42-6b68688f7f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d

Started

Container started

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-87293f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-87293f-68d6999dd8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-f37d42-78585ddd78

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-f37d42-78585ddd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f37d42: serviceaccount "payload-processing-e2e-api-a-f37d42" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-f37d42: serviceaccount "payload-processing-e2e-api-a-f37d42" not found

openshift-ingress

multus

payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-87293f-68d6999dd8

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-87293f-68d6999dd8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-87293f: serviceaccount "payload-processing-e2e-api-a-87293f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-87293f: serviceaccount "payload-processing-e2e-api-a-87293f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-87293f-68d6999dd8

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn

openshift-ingress

multus

payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn

openshift-ingress

kubelet

payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-87293f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-87293f-58bf6f75cf from 0 to 1

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 3 to 5

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulCreate

Created pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

openshift-ingress

multus

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

AddedInterface

Add eth0 [10.133.0.117/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulCreate

Created pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

SuccessfulRescale

New size: 5; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87293f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Unhealthy

Liveness probe failed: Get "https://10.133.0.47:8000/health": context deadline exceeded

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87293f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x9)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

ProbeError

Startup probe error: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused body:
(x10)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

Unhealthy

Startup probe failed: Get "http://10.133.0.117:15021/healthz/ready": dial tcp 10.133.0.117:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 5 to 8

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

Started

Container started

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

Started

Container started

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

Created

Container created

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

AddedInterface

Add eth0 [10.133.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f37d42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f37d42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

Unhealthy

Startup probe failed: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

ProbeError

Startup probe error: Get "http://10.133.0.119:15021/healthz/ready": dial tcp 10.133.0.119:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-7784e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7784e5-openshift-default-564776f9f from 0 to 1

openshift-ingress

deployment-controller

e2e-api-b-066928-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-066928-openshift-default-55ddf5c76f from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-066928-openshift-default-55ddf5c76f

SuccessfulCreate

Created pod: e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87293f-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

e2e-api-b-7784e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7784e5

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-87293f-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-api-b-7784e5-openshift-default-564776f9f

SuccessfulCreate

Created pod: e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

openshift-ingress

gateway_labeler_controller

e2e-api-b-066928

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-066928

openshift-ingress

multus

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

AddedInterface

Add eth0 [10.133.0.120/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

AddedInterface

Add eth0 [10.133.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7784e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7784e5-79887659d4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-066928-5866c665f8

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-066928-5866c665f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-066928: serviceaccount "payload-processing-e2e-api-b-066928" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-066928-69f65fb487

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-066928-69f65fb487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-066928: serviceaccount "payload-processing-e2e-api-b-066928" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-066928-5866c665f8

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-066928-5866c665f8-pzkx5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-066928

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-066928-69f65fb487 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-066928

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-066928-5866c665f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-066928-69f65fb487

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-066928-5866c665f8-pzkx5

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7784e5-79887659d4

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7784e5-79887659d4-5hll8

openshift-ingress

multus

payload-processing-e2e-api-b-7784e5-79887659d4-5hll8

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-066928-5866c665f8-pzkx5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-7784e5-79887659d4-5hll8

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-066928-5866c665f8-pzkx5

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7784e5-79887659d4

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7784e5-79887659d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7784e5: serviceaccount "payload-processing-e2e-api-b-7784e5" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-066928-5866c665f8-pzkx5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-b-7784e5-79887659d4-5hll8

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7784e5-79887659d4-5hll8

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7784e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7784e5-65dbcf8555 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7784e5: serviceaccount "payload-processing-e2e-api-b-7784e5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f37d42-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-api-a-f37d42-openshift-default-7645c57f7c

SuccessfulCreate

Created pod: e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

openshift-ingress

replicaset-controller

e2e-api-a-f37d42-openshift-default-7645c57f7c

SuccessfulCreate

Created pod: e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

openshift-ingress

replicaset-controller

e2e-api-a-f37d42-openshift-default-7645c57f7c

SuccessfulCreate

Created pod: e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss
(x2)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-api-a-f37d42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-f37d42-openshift-default-7645c57f7c from 1 to 4
(x2)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

Created

Container created

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

Started

Container started

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

Created

Container created

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

Started

Container started

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

Created

Container created

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

Created

Container created

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

AddedInterface

Add eth0 [10.133.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

Started

Container started

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-mt-da58b769-openshift-default-69887ddf8f

SuccessfulCreate

Created pod: e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

openshift-ingress

deployment-controller

e2e-mt-da58b769-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-da58b769-openshift-default-69887ddf8f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-da58b769

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-da58b769

openshift-ingress

multus

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

AddedInterface

Add eth0 [10.133.0.123/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

ProbeError

Startup probe error: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

Unhealthy

Startup probe failed: Get "http://10.133.0.122:15021/healthz/ready": dial tcp 10.133.0.122:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da58b769-7ddb646744

SuccessfulCreate

Created pod: payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-da58b769

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-da58b769-786c599f47 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da58b769-7ddb646744

FailedCreate

Error creating: pods "payload-processing-e2e-mt-da58b769-7ddb646744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da58b769: serviceaccount "payload-processing-e2e-mt-da58b769" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-da58b769

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-da58b769-7ddb646744 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da58b769-786c599f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-da58b769-786c599f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da58b769: serviceaccount "payload-processing-e2e-mt-da58b769" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da58b769-786c599f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

Created

Container created

openshift-ingress

multus

payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f37d42-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-f37d42-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7784e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7784e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-gs6dj

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 2 to 3

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-gs6dj

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gs6dj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-87293f-58bf6f75cf-85cbn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gs6dj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 2.648s (2.648s including waiting). Image size: 185476477 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gs6dj

Created

Container created

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-gs6dj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-api-a-87293f-68d6999dd8-cv2vn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-f37d42-78585ddd78-qlc7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-f37d42-6b68688f7f-tx6m4

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-066928-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-066928-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da58b769-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

ProbeError

Readiness probe error: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

Unhealthy

Readiness probe failed: Get "http://10.133.0.116:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

Unhealthy

Startup probe failed: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da58b769-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

ProbeError

Startup probe error: Get "http://10.133.0.120:15021/healthz/ready": dial tcp 10.133.0.120:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

Unhealthy

Startup probe failed: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

ProbeError

Startup probe error: Get "http://10.133.0.121:15021/healthz/ready": dial tcp 10.133.0.121:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

ProbeError

Startup probe error: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

Unhealthy

Startup probe failed: Get "http://10.133.0.116:15021/healthz/ready": dial tcp 10.133.0.116:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-87293f-openshift-default-7c9c9cbc7f-vw6fm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-hkzkf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-6xbss

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-22qrl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-f37d42-openshift-default-7645c57f7c-jxwns

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-066928-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-066928-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

Unhealthy

Startup probe failed: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7784e5-65dbcf8555-fgbxk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7784e5-79887659d4-5hll8

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

ProbeError

Startup probe error: Get "http://10.133.0.123:15021/healthz/ready": dial tcp 10.133.0.123:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-066928-5866c665f8-pzkx5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-066928-69f65fb487-fdp79

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7784e5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-7784e5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da58b769-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-mt-da58b769-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-api-b-066928-openshift-default-55ddf5c76f-pzlmw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-dc0f87-openshift-default-66c7fb4749

SuccessfulCreate

Created pod: e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

openshift-ingress

deployment-controller

e2e-api-a-dc0f87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-dc0f87-openshift-default-66c7fb4749 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-dc0f87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dc0f87

openshift-ingress

multus

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-api-b-7784e5-openshift-default-564776f9f-zm98k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc0f87-84978868ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-dc0f87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-dc0f87-84978868ff from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc0f87-84978868ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-dc0f87-84978868ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc0f87: serviceaccount "payload-processing-e2e-api-a-dc0f87" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc0f87: serviceaccount "payload-processing-e2e-api-a-dc0f87" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t

Started

Container started

openshift-ingress

multus

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-dc0f87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-dc0f87-54d6cc5b6b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-9982ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9982ad-openshift-default-6f478df445 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-9982ad-openshift-default-6f478df445

SuccessfulCreate

Created pod: e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

openshift-ingress

gateway_labeler_controller

e2e-api-b-9982ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9982ad

openshift-ingress

multus

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

AddedInterface

Add eth0 [10.133.0.130/23] from ovn-kubernetes

opendatahub

multus

test-curl-7496-11401a

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7496-11401a

Pulling

Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9982ad-b9cb8c9cd

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9982ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9982ad: serviceaccount "payload-processing-e2e-api-b-9982ad" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9982ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9982ad-b9cb8c9cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9982ad-b9cb8c9cd

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9982ad-b9cb8c9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9982ad: serviceaccount "payload-processing-e2e-api-b-9982ad" not found

openshift-ingress

multus

payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7496-11401a

Pulled

Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 3.266s (3.266s including waiting). Image size: 106100986 bytes.

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-dc0f87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-dc0f87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7496-11401a

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6

Started

Container started

opendatahub

kubelet

test-curl-7496-11401a

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7496-11401a

Killing

Stopping container test-curl-7496-11401a

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-93574a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-93574a

openshift-ingress

deployment-controller

e2e-ipp-a-93574a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-93574a-openshift-default-54946f844f from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-93574a-openshift-default-54946f844f

SuccessfulCreate

Created pod: e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

openshift-ingress

multus

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

AddedInterface

Add eth0 [10.133.0.132/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-93574a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-93574a-689766c59 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-93574a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-93574a-dddd744fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-93574a-dddd744fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-93574a-dddd744fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-93574a: serviceaccount "payload-processing-e2e-ipp-a-93574a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-93574a-689766c59

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-93574a-689766c59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-93574a: serviceaccount "payload-processing-e2e-ipp-a-93574a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ipp-a-040d9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-040d9c-openshift-default-5f6d95fff9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-040d9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-040d9c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-93574a-689766c59

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-93574a-dddd744fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9

SuccessfulCreate

Created pod: e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v

Created

Container created

openshift-ingress

multus

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

AddedInterface

Add eth0 [10.133.0.134/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-040d9c: serviceaccount "payload-processing-e2e-ipp-a-040d9c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-040d9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-040d9c-6f7b767444 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-040d9c-6f7b767444

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-040d9c-6f7b767444

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-040d9c-6f7b767444-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-040d9c: serviceaccount "payload-processing-e2e-ipp-a-040d9c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-040d9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv

AddedInterface

Add eth0 [10.132.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9982ad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9982ad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-dddd744fd-9zb5v

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-sf54z

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-689766c59-vppms

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-d7dnj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

gateway_labeler_controller

e2e-api-a-8f1c37

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-8f1c37

openshift-ingress

deployment-controller

e2e-api-a-8f1c37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-8f1c37-openshift-default-7cd9c57fdf from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf

SuccessfulCreate

Created pod: e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc0f87-54d6cc5b6b-zrd9c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc0f87-84978868ff-72m7t

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

AddedInterface

Add eth0 [10.133.0.136/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-93574a-ccbc886cb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-93574a-ccbc886cb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-93574a-ccbc886cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-93574a: serviceaccount "payload-processing-e2e-ipp-a-93574a" not found
(x2)

openshift-ingress

kubelet

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-93574a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-93574a-84684456c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-6f7b767444-gc4bs

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-93574a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-93574a-ccbc886cb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-93574a-84684456c9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-93574a-84684456c9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-93574a-84684456c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-93574a: serviceaccount "payload-processing-e2e-ipp-a-93574a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-7b448dc8c9-sxlvv

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-8f1c37

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-8f1c37

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-8f1c37-677b95b7d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5

AddedInterface

Add eth0 [10.133.0.137/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb

AddedInterface

Add eth0 [10.133.0.138/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8f1c37: serviceaccount "payload-processing-e2e-api-a-8f1c37" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8f1c37-677b95b7d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8f1c37-677b95b7d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-8f1c37-677b95b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8f1c37: serviceaccount "payload-processing-e2e-api-a-8f1c37" not found

openshift-ingress

multus

payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da58b769-786c599f47

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-da58b769-786c599f47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da58b769: serviceaccount "payload-processing-e2e-mt-da58b769" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-da58b769

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-da58b769-786c599f47 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-da58b769-786c599f47

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da58b769-7ddb646744

FailedCreate

Error creating: pods "payload-processing-e2e-mt-da58b769-7ddb646744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-da58b769: serviceaccount "payload-processing-e2e-mt-da58b769" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-da58b769-7ddb646744

SuccessfulCreate

Created pod: payload-processing-e2e-mt-da58b769-7ddb646744-dvj75

openshift-ingress

deployment-controller

payload-processing-e2e-mt-da58b769

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-da58b769-7ddb646744 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.367s (3.368s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-dvj75

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-dvj75

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-dvj75

Started

Container started

openshift-ingress

multus

payload-processing-e2e-mt-da58b769-7ddb646744-dvj75

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.309s (3.309s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

ProbeError

Startup probe error: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

Unhealthy

Startup probe failed: Get "http://10.133.0.130:15021/healthz/ready": dial tcp 10.133.0.130:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-040d9c-598f4c788b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-040d9c: serviceaccount "payload-processing-e2e-ipp-a-040d9c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-040d9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-040d9c-9848c8999 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-040d9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-040d9c-598f4c788b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-040d9c-598f4c788b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-040d9c-598f4c788b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-040d9c: serviceaccount "payload-processing-e2e-ipp-a-040d9c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

AddedInterface

Add eth0 [10.132.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

AddedInterface

Add eth0 [10.132.0.113/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.737s (4.737s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.785s (4.785s including waiting). Image size: 166612641 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-24fceb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-24fceb

openshift-ingress

replicaset-controller

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc

SuccessfulCreate

Created pod: e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

openshift-ingress

deployment-controller

e2e-ipp-b-24fceb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-24fceb-openshift-default-797c7dc6fc from 0 to 1
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-dc0f87-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-dc0f87-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

AddedInterface

Add eth0 [10.133.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Unhealthy

Readiness probe failed: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

ProbeError

Readiness probe error: Get "http://10.133.0.134:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

Created

Container created

openshift-ingress

replicaset-controller

e2e-api-b-12a6e1-openshift-default-5d85cdb88c

SuccessfulCreate

Created pod: e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

openshift-ingress

deployment-controller

e2e-api-b-12a6e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-12a6e1-openshift-default-5d85cdb88c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Started

Container started

openshift-ingress

gateway_labeler_controller

e2e-api-b-12a6e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-12a6e1
(x2)

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Created

Container created

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24fceb: serviceaccount "payload-processing-e2e-ipp-b-24fceb" not found

openshift-ingress

multus

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

AddedInterface

Add eth0 [10.133.0.140/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-24fceb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-24fceb-7784669d4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24fceb-7784669d4b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24fceb-7784669d4b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-24fceb-7784669d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24fceb: serviceaccount "payload-processing-e2e-ipp-b-24fceb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-24fceb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf

AddedInterface

Add eth0 [10.132.0.116/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj

AddedInterface

Add eth0 [10.132.0.115/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-e7e190

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-e7e190

openshift-ingress

deployment-controller

e2e-ipp-b-e7e190-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-e7e190-openshift-default-58b77988c5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-ipp-b-e7e190-openshift-default-58b77988c5

SuccessfulCreate

Created pod: e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj

Started

Container started

openshift-ingress

multus

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

AddedInterface

Add eth0 [10.132.0.117/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-93574a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-93574a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9982ad-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-9982ad-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-12a6e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-12a6e1-698647d9b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-12a6e1-698647d9b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p

openshift-ingress

multus

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-12a6e1-698647d9b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-12a6e1-698647d9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-12a6e1: serviceaccount "payload-processing-e2e-api-b-12a6e1" not found

openshift-ingress

kubelet

e2e-api-a-dc0f87-openshift-default-66c7fb4749-7c7vh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-12a6e1: serviceaccount "payload-processing-e2e-api-b-12a6e1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-12a6e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p

AddedInterface

Add eth0 [10.132.0.118/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

Unhealthy

Startup probe failed: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused

opendatahub

multus

test-curl-7496-be5069

AddedInterface

Add eth0 [10.132.0.119/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

ProbeError

Startup probe error: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Unhealthy

Startup probe failed: Get "http://10.133.0.134:15021/healthz/ready": dial tcp 10.133.0.134:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

ProbeError

Startup probe error: Get "http://10.133.0.132:15021/healthz/ready": dial tcp 10.133.0.132:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7496-be5069

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7496-be5069

Created

Container created

opendatahub

kubelet

test-curl-7496-be5069

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e7e190: serviceaccount "payload-processing-e2e-ipp-b-e7e190" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e7e190

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e7e190-758bf6f768 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e7e190

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e7e190-758bf6f768

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e7e190-758bf6f768-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e7e190: serviceaccount "payload-processing-e2e-ipp-b-e7e190" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e7e190-758bf6f768

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-040d9c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-040d9c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

opendatahub

kubelet

test-curl-7496-be5069

Killing

Stopping container test-curl-7496-be5069

openshift-ingress

kubelet

payload-processing-e2e-api-b-9982ad-b9cb8c9cd-t92mp

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-12a6e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-12a6e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9982ad-56b9dc5dd7-b94s6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-da58b769-7ddb646744-dvj75

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-da58b769-786c599f47-kbbwb

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-7784669d4b-8ztnf

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-040d9c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-040d9c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-5b8577b5f5-g62jj

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

ProbeError

Startup probe error: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

Unhealthy

Startup probe failed: Get "http://10.133.0.136:15021/healthz/ready": dial tcp 10.133.0.136:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6b6ff8bc7f-z868m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-758bf6f768-j56l4

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8f1c37-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8f1c37-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24fceb: serviceaccount "payload-processing-e2e-ipp-b-24fceb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-24fceb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-24fceb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-24fceb-79f8dc5dd from 0 to 1
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-93574a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-93574a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-24fceb: serviceaccount "payload-processing-e2e-ipp-b-24fceb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e7e190

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e7e190-6568d5799 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e7e190-56646ff9d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e7e190-56646ff9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e7e190: serviceaccount "payload-processing-e2e-ipp-b-e7e190" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e7e190: serviceaccount "payload-processing-e2e-ipp-b-e7e190" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e7e190

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e7e190-56646ff9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e7e190-56646ff9d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg

openshift-ingress

kubelet

payload-processing-e2e-api-a-8f1c37-677b95b7d-6q6qg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-9982ad-openshift-default-6f478df445-gr62t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8f1c37-6fff6dcbb7-vz825

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

ProbeError

Readiness probe error: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

Unhealthy

Readiness probe failed: Get "http://10.133.0.139:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc

SuccessfulCreate

Created pod: e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-54bc2b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-54bc2b
(x2)

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-a-54bc2b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-54bc2b-openshift-default-bf84f77dc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

Created

Container created

openshift-ingress

multus

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

AddedInterface

Add eth0 [10.133.0.144/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54bc2b: serviceaccount "payload-processing-e2e-ipp-a-54bc2b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54bc2b: serviceaccount "payload-processing-e2e-ipp-a-54bc2b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-54bc2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-54bc2b-5fd7f74668 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-54bc2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd

openshift-ingress

multus

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd

AddedInterface

Add eth0 [10.132.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

ProbeError

Startup probe error: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

Unhealthy

Startup probe failed: Get "http://10.133.0.139:15021/healthz/ready": dial tcp 10.133.0.139:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

ProbeError

Startup probe error: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

Unhealthy

Startup probe failed: Get "http://10.132.0.117:15021/healthz/ready": dial tcp 10.132.0.117:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24fceb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24fceb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8f1c37-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-a-8f1c37-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e7e190-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e7e190-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-api-a-8f1c37-openshift-default-7cd9c57fdf-kwhps

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-040d9c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-040d9c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-040d9c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-040d9c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d5fcea38-7150-4193-b089-25377690bf08, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-040d9c-9848c8999-gk44v

Unhealthy

Readiness probe failed: dial tcp 10.132.0.112:9004: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24fceb-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-24fceb-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-040d9c-598f4c788b-r7xx2

Unhealthy

Readiness probe failed: dial tcp 10.132.0.113:9004: i/o timeout

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4f8j2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-jrf7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-z655g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 10 to 7

openshift-ingress

replicaset-controller

e2e-praxis-a-6a327a-openshift-default-958795d8f

SuccessfulCreate

Created pod: e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-12a6e1-858d56dc8c-m8kb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-5fd7f74668-5zd2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-praxis-a-6a327a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-6a327a-openshift-default-958795d8f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-6a327a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-6a327a

openshift-ingress

kubelet

e2e-mt-da58b769-openshift-default-69887ddf8f-n79ls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-12a6e1-698647d9b-rwr4p

Killing

Stopping container payload-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e7e190-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-585958d99f-j6dbd

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-e7e190-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

AddedInterface

Add eth0 [10.132.0.129/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-6a327a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-6a327a-695c9989b8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54bc2b-78c54d9486

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-54bc2b-78c54d9486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54bc2b: serviceaccount "payload-processing-e2e-ipp-a-54bc2b" not found
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6a327a-695c9989b8

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-6a327a-695c9989b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6a327a: serviceaccount "payload-processing-e2e-praxis-a-6a327a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-6a327a-695c9989b8

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-54bc2b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-6a327a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-6a327a-679688748c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-54bc2b: serviceaccount "payload-processing-e2e-ipp-a-54bc2b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-54bc2b-78c54d9486

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-54bc2b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-54bc2b-78c54d9486 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6a327a-679688748c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-6a327a-679688748c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-6a327a: serviceaccount "payload-processing-e2e-praxis-a-6a327a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-6a327a-679688748c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

AddedInterface

Add eth0 [10.132.0.131/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

Started

Container started

openshift-ingress

multus

payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr

AddedInterface

Add eth0 [10.132.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

AddedInterface

Add eth0 [10.132.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5

AddedInterface

Add eth0 [10.132.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5

Created

Container created

openshift-ingress

kubelet

e2e-ipp-a-040d9c-openshift-default-5f6d95fff9-2pjrx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-12a6e1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-api-b-12a6e1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e7e190-6568d5799-fnlnk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e7e190-56646ff9d-plbrg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

Unhealthy

Startup probe failed: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

ProbeError

Startup probe error: Get "http://10.133.0.140:15021/healthz/ready": dial tcp 10.133.0.140:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-b-fe0612-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-fe0612-openshift-default-884c77ff7 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

AddedInterface

Add eth0 [10.132.0.135/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-fe0612-openshift-default-884c77ff7

SuccessfulCreate

Created pod: e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-fe0612

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-fe0612
(x6)

openshift-ingress

kubelet

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

Unhealthy

Startup probe failed: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

ProbeError

Startup probe error: Get "http://10.133.0.144:15021/healthz/ready": dial tcp 10.133.0.144:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-praxis-a-655193-openshift-default-7fc4b9c797

SuccessfulCreate

Created pod: e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-655193

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-655193

openshift-ingress

deployment-controller

e2e-praxis-a-655193-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-655193-openshift-default-7fc4b9c797 from 0 to 1

openshift-ingress

multus

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

AddedInterface

Add eth0 [10.132.0.136/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-e7e190-openshift-default-58b77988c5-qfwrg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-praxis-b-a014d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-a014d1-openshift-default-566cdcf765 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-a014d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-a014d1

openshift-ingress

replicaset-controller

e2e-praxis-b-a014d1-openshift-default-566cdcf765

SuccessfulCreate

Created pod: e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

openshift-ingress

multus

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

AddedInterface

Add eth0 [10.133.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-12a6e1-openshift-default-5d85cdb88c-85478

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

Created

Container created

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-fe0612

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-praxis-a-f778f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-a-f778f5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe0612: serviceaccount "payload-processing-e2e-ipp-b-fe0612" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf

openshift-ingress

deployment-controller

e2e-praxis-a-f778f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-a-f778f5-openshift-default-6d944754c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe0612-55bdc47886

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe0612-55bdc47886

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-fe0612-55bdc47886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe0612: serviceaccount "payload-processing-e2e-ipp-b-fe0612" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-fe0612

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-fe0612-55bdc47886 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-a-f778f5-openshift-default-6d944754c7

SuccessfulCreate

Created pod: e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-655193

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-655193-d795fdd78 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf

AddedInterface

Add eth0 [10.132.0.138/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulDelete

Deleted pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

openshift-ingress

multus

payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg

AddedInterface

Add eth0 [10.132.0.137/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-b7vtg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-655193

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 5 to 4

openshift-ingress

multus

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

AddedInterface

Add eth0 [10.132.0.139/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg

Created

Container created
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-655193: serviceaccount "payload-processing-e2e-praxis-a-655193" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-655193-d795fdd78

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-655193-d795fdd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-655193: serviceaccount "payload-processing-e2e-praxis-a-655193" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-655193-d795fdd78

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54bc2b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk

openshift-ingress

multus

payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh

AddedInterface

Add eth0 [10.132.0.141/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-a014d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-a014d1-77457c8579 from 0 to 1
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54bc2b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a014d1-6c8d56cb

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-a014d1-6c8d56cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a014d1: serviceaccount "payload-processing-e2e-praxis-b-a014d1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj

AddedInterface

Add eth0 [10.132.0.140/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-a014d1: serviceaccount "payload-processing-e2e-praxis-b-a014d1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-a014d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-a014d1-6c8d56cb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-a014d1-6c8d56cb

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9

Started

Container started

openshift-ingress

deployment-controller

e2e-ipp-a-93574a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-93574a-openshift-default-54946f844f from 1 to 2

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9

AddedInterface

Add eth0 [10.132.0.143/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

AddedInterface

Add eth0 [10.132.0.144/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-93574a-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9

Created

Container created

openshift-ingress

replicaset-controller

e2e-ipp-a-93574a-openshift-default-54946f844f

SuccessfulCreate

Created pod: e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk

AddedInterface

Add eth0 [10.132.0.142/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f778f5-7fb6467b98

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-a-f778f5-7fb6467b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f778f5: serviceaccount "payload-processing-e2e-praxis-a-f778f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-a-f778f5-7fb6467b98

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-a-f778f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-a-f778f5-7fb6467b98 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

Started

Container started
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-a-f778f5: serviceaccount "payload-processing-e2e-praxis-a-f778f5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-a-f778f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

AddedInterface

Add eth0 [10.132.0.145/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-sslrz

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-xxdvn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-hkbqs

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

Unhealthy

Startup probe failed: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

ProbeError

Startup probe error: Get "http://10.132.0.144:15021/healthz/ready": dial tcp 10.132.0.144:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a327a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 10 to 7

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-d6xvs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8ljch

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-fjf7p
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a327a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54bc2b-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-a-54bc2b-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x6)

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

ProbeError

Startup probe error: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

Unhealthy

Startup probe failed: Get "http://10.132.0.129:15021/healthz/ready": dial tcp 10.132.0.129:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-10d367

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-10d367

openshift-ingress

deployment-controller

e2e-praxis-b-10d367-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-10d367-openshift-default-6fd7bbffc from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-10d367-openshift-default-6fd7bbffc

SuccessfulCreate

Created pod: e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

openshift-ingress

multus

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

AddedInterface

Add eth0 [10.132.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-5ffbfd647-2k8mf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-55bdc47886-fbksg

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulDelete

Deleted pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-rjtfp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-10d367: serviceaccount "payload-processing-e2e-praxis-b-10d367" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-10d367-5fc56d84b4

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-10d367-5fc56d84b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-10d367: serviceaccount "payload-processing-e2e-praxis-b-10d367" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-10d367-5fc56d84b4

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-10d367

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-10d367-5fc56d84b4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-10d367

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q

AddedInterface

Add eth0 [10.132.0.148/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z

AddedInterface

Add eth0 [10.132.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q

Started

Container started
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe0612: serviceaccount "payload-processing-e2e-ipp-b-fe0612" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx

openshift-ingress

multus

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

AddedInterface

Add eth0 [10.133.0.150/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-fe0612-openshift-default-884c77ff7

SuccessfulCreate

Created pod: e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

openshift-ingress

replicaset-controller

e2e-ipp-b-fe0612-openshift-default-884c77ff7

SuccessfulCreate

Created pod: e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-fe0612

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe0612-586d4f84f6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-fe0612-586d4f84f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fe0612: serviceaccount "payload-processing-e2e-ipp-b-fe0612" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fe0612-586d4f84f6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-fe0612

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-fe0612-586d4f84f6 from 0 to 1

openshift-ingress

deployment-controller

e2e-ipp-b-fe0612-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-fe0612-openshift-default-884c77ff7 from 1 to 3

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe0612-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

Started

Container started

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

Created

Container created

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

Created

Container created

openshift-ingress

multus

payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

AddedInterface

Add eth0 [10.132.0.151/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx

AddedInterface

Add eth0 [10.132.0.150/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-praxis-b-3d1aa8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-praxis-b-3d1aa8

openshift-ingress

deployment-controller

e2e-praxis-b-3d1aa8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885 from 0 to 1

openshift-ingress

replicaset-controller

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885

SuccessfulCreate

Created pod: e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a014d1-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

AddedInterface

Add eth0 [10.133.0.151/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-a014d1-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

ProbeError

Readiness probe error: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

Unhealthy

Readiness probe failed: Get "http://10.132.0.135:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

ProbeError

Readiness probe error: Get "http://10.132.0.136:15021/healthz/ready": read tcp 10.132.0.2:41618->10.132.0.136:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

Unhealthy

Readiness probe failed: Get "http://10.132.0.136:15021/healthz/ready": read tcp 10.132.0.2:41618->10.132.0.136:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

Created

Container created
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

Unhealthy

Startup probe failed: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

ProbeError

Startup probe error: Get "http://10.133.0.150:15021/healthz/ready": dial tcp 10.133.0.150:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-praxis-b-3d1aa8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-praxis-b-3d1aa8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95

SuccessfulCreate

Created pod: payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b

FailedCreate

Error creating: pods "payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3d1aa8: serviceaccount "payload-processing-e2e-praxis-b-3d1aa8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b

SuccessfulCreate

Created pod: payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95

FailedCreate

Error creating: pods "payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-praxis-b-3d1aa8: serviceaccount "payload-processing-e2e-praxis-b-3d1aa8" not found

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qht75

Unhealthy

Readiness probe failed: Get "https://10.132.0.41:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

Unhealthy

Startup probe failed: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

ProbeError

Startup probe error: Get "http://10.132.0.135:15021/healthz/ready": dial tcp 10.132.0.135:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

ProbeError

Startup probe error: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

Unhealthy

Startup probe failed: Get "http://10.132.0.139:15021/healthz/ready": dial tcp 10.132.0.139:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

ProbeError

Startup probe error: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

Unhealthy

Startup probe failed: Get "http://10.132.0.136:15021/healthz/ready": dial tcp 10.132.0.136:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs

Started

Container started

openshift-ingress

multus

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv

AddedInterface

Add eth0 [10.132.0.153/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs

AddedInterface

Add eth0 [10.132.0.154/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe0612-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe0612-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-655193-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-655193-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-10d367-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-10d367-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f778f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f778f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a327a-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-6a327a-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-54bc2b-78c54d9486-m8wgr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-54bc2b-75665fb467-9mcc5

Killing

Stopping container payload-pre-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe0612-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-ipp-b-fe0612-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-655193-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-655193-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-a-54bc2b-openshift-default-bf84f77dc-jqfxp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f778f5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-a-f778f5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

kubelet

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

Unhealthy

Startup probe failed: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

ProbeError

Startup probe error: Get "http://10.132.0.147:15021/healthz/ready": dial tcp 10.132.0.147:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-655193-d795fdd78-d5kjh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-655193-6ddd86dcff-vwfxj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-praxis-a-655193-openshift-default-7fc4b9c797-wtfmv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93574a-ccbc886cb-kq9wb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93574a-84684456c9-k4pt5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fe0612-7f874c54bc-jqzvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fe0612-586d4f84f6-cvhrc

Unhealthy

Readiness probe failed: dial tcp 10.132.0.151:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-q4fdl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-v5fg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-fe0612-openshift-default-884c77ff7-vd5tv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-f778f5-7fb6467b98-lfp5t

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.145:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-f778f5-f9577cdf5-84m4z

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.92:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-10d367-6cbf6ddcbc-xnr6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-10d367-5fc56d84b4-zdh4z

Killing

Stopping container payload-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-10d367-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-10d367-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

ProbeError

Readiness probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

Unhealthy

Readiness probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-a-f778f5-openshift-default-6d944754c7-xq8rw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

ProbeError

Startup probe error: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

Unhealthy

Startup probe failed: Get "http://10.133.0.151:15021/healthz/ready": dial tcp 10.133.0.151:15021: connect: connection refused

openshift-ingress

kubelet

e2e-praxis-b-10d367-openshift-default-6fd7bbffc-8vt22

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-3d1aa8-7596c58d6b-mjvxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-3d1aa8-785bb8bc95-6tmqs

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3d1aa8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-praxis-b-3d1aa8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-68cb9b4b95-h74bt

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-h74bt

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-68cb9b4b95 from 10 to 9

openshift-ingress

kubelet

e2e-praxis-b-3d1aa8-openshift-default-7d4db8c885-69589

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-cgr82

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-93574a-openshift-default-54946f844f-mqjh9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

Unhealthy

Readiness probe failed: Get "http://10.133.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

ProbeError

Readiness probe error: Get "http://10.133.0.115:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

AddedInterface

Add eth0 [10.132.0.158/23] from ovn-kubernetes
(x2)

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 7 to 10

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

AddedInterface

Add eth0 [10.132.0.159/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

ProbeError

Startup probe error: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

Unhealthy

Startup probe failed: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

ProbeError

Startup probe error: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

Unhealthy

Startup probe failed: Get "http://10.134.0.100:15021/healthz/ready": dial tcp 10.134.0.100:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

Unhealthy

Startup probe failed: Get "http://10.132.0.159:15021/healthz/ready": dial tcp 10.132.0.159:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

ProbeError

Startup probe error: Get "http://10.132.0.158:15021/healthz/ready": dial tcp 10.132.0.158:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-24fceb-657cc9b99f-4tcw8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-24fceb-79f8dc5dd-d5lx6

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 7 to 10

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

Created

Container created

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

AddedInterface

Add eth0 [10.132.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

Started

Container started

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

AddedInterface

Add eth0 [10.132.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

Started

Container started

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

AddedInterface

Add eth0 [10.132.0.161/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulCreate

(combined from similar events): Created pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 7 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

AddedInterface

Add eth0 [10.132.0.163/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

AddedInterface

Add eth0 [10.132.0.165/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

AddedInterface

Add eth0 [10.132.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-ipp-b-24fceb-openshift-default-797c7dc6fc-hs9td

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

Started

Container started

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

Created

Container created

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x12)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

Unhealthy

Startup probe failed: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

Unhealthy

Startup probe failed: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": dial tcp 10.132.0.161:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

ProbeError

Startup probe error: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused body:
(x12)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

Unhealthy

Startup probe failed: Get "http://10.132.0.162:15021/healthz/ready": dial tcp 10.132.0.162:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

ProbeError

Startup probe error: Get "http://10.132.0.160:15021/healthz/ready": dial tcp 10.132.0.160:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

ProbeError

Startup probe error: Get "http://10.132.0.161:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-praxis-a-6a327a-695c9989b8-9h65w

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-a-6a327a-679688748c-6nt2t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x12)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

Unhealthy

Startup probe failed: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

Unhealthy

Startup probe failed: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused
(x12)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

Unhealthy

Startup probe failed: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused
(x13)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

ProbeError

Startup probe error: Get "http://10.132.0.163:15021/healthz/ready": dial tcp 10.132.0.163:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

ProbeError

Startup probe error: Get "http://10.132.0.164:15021/healthz/ready": dial tcp 10.132.0.164:15021: connect: connection refused body:
(x13)

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

ProbeError

Startup probe error: Get "http://10.132.0.165:15021/healthz/ready": dial tcp 10.132.0.165:15021: connect: connection refused body:

llm

kubelet

echo-simulator-kserve-64b6f8f96c-qht75

Unhealthy

Readiness probe failed: Get "https://10.132.0.41:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x10)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Unhealthy

Readiness probe failed: Get "https://10.133.0.47:8000/ready": context deadline exceeded

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Unhealthy

Liveness probe failed: Get "https://10.133.0.47:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

Unhealthy

Readiness probe failed: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x3)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

ProbeError

Readiness probe error: Get "http://10.133.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-a1d55d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-a1d55d

openshift-ingress

replicaset-controller

e2e-shared-a-w4-ef6b56-openshift-default-768647479

SuccessfulCreate

Created pod: e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

openshift-ingress

deployment-controller

e2e-shared-a-w4-ef6b56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-ef6b56-openshift-default-768647479 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-ef6b56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-ef6b56

openshift-ingress

deployment-controller

e2e-shared-a-w2-a1d55d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

AddedInterface

Add eth0 [10.132.0.167/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

AddedInterface

Add eth0 [10.132.0.166/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff

SuccessfulCreate

Created pod: e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-ef6b56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-ef6b56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-a1d55d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-ef6b56: serviceaccount "payload-processing-e2e-shared-a-w4-ef6b56" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-ef6b56: serviceaccount "payload-processing-e2e-shared-a-w4-ef6b56" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd

AddedInterface

Add eth0 [10.132.0.168/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-a1d55d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-a1d55d-669c459d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd

Created

Container created

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

AddedInterface

Add eth0 [10.132.0.169/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76

AddedInterface

Add eth0 [10.132.0.171/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a1d55d: serviceaccount "payload-processing-e2e-shared-a-w2-a1d55d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a1d55d: serviceaccount "payload-processing-e2e-shared-a-w2-a1d55d" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

AddedInterface

Add eth0 [10.132.0.170/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc

SuccessfulCreate

Created pod: e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

openshift-ingress

deployment-controller

e2e-shared-a-w3-c2e3f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-c2e3f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-c2e3f9

openshift-ingress

multus

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

AddedInterface

Add eth0 [10.133.0.191/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w0-baa504

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w0-baa504

openshift-ingress

deployment-controller

e2e-shared-a-w0-baa504-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5

SuccessfulCreate

Created pod: e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

openshift-ingress

multus

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

AddedInterface

Add eth0 [10.133.0.192/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-c2e3f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-c2e3f9-5889544686 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Unhealthy

Readiness probe failed: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

ProbeError

Readiness probe error: Get "http://10.132.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c2e3f9: serviceaccount "payload-processing-e2e-shared-a-w3-c2e3f9" not found

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-c2e3f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c2e3f9: serviceaccount "payload-processing-e2e-shared-a-w3-c2e3f9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

AddedInterface

Add eth0 [10.132.0.174/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

AddedInterface

Add eth0 [10.132.0.175/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

Created

Container created

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 7 to 10
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 10; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w0-baa504

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f

SuccessfulCreate

Created pod: e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

openshift-ingress

deployment-controller

e2e-shared-b-w2-ef6be7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

Started

Container started

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-ed012e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-ed012e

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-ef6be7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-ef6be7

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulCreate

Created pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

AddedInterface

Add eth0 [10.132.0.176/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

e2e-shared-b-w4-ed012e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc

SuccessfulCreate

Created pod: e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

Started

Container started

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w0-baa504

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

AddedInterface

Add eth0 [10.132.0.177/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

AddedInterface

Add eth0 [10.133.0.193/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-baa504: serviceaccount "payload-processing-e2e-shared-a-w0-baa504" not found

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w0-baa504: serviceaccount "payload-processing-e2e-shared-a-w0-baa504" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

AddedInterface

Add eth0 [10.133.0.195/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5

Started

Container started

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq

openshift-ingress

multus

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

AddedInterface

Add eth0 [10.133.0.194/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq

AddedInterface

Add eth0 [10.132.0.178/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq

Created

Container created

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-praxis-a-6a327a-openshift-default-958795d8f-hn2q9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ef6be7: serviceaccount "payload-processing-e2e-shared-b-w2-ef6be7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-ef6be7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-ef6be7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ef6be7: serviceaccount "payload-processing-e2e-shared-b-w2-ef6be7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-ed012e: serviceaccount "payload-processing-e2e-shared-b-w4-ed012e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-ed012e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

ProbeError

Startup probe error: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

Unhealthy

Startup probe failed: Get "http://10.133.0.193:15021/healthz/ready": dial tcp 10.133.0.193:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-ed012e: serviceaccount "payload-processing-e2e-shared-b-w4-ed012e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-ed012e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976 from 0 to 1
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

Unhealthy

Startup probe failed: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

AddedInterface

Add eth0 [10.132.0.181/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

ProbeError

Startup probe error: Get "http://10.132.0.177:15021/healthz/ready": dial tcp 10.132.0.177:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

ProbeError

Startup probe error: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

AddedInterface

Add eth0 [10.132.0.180/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

Unhealthy

Startup probe failed: Get "http://10.132.0.176:15021/healthz/ready": dial tcp 10.132.0.176:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-praxis-b-a014d1-6c8d56cb-wxpj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-praxis-b-a014d1-77457c8579-jlhrk

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-b-w3-2d1c71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-2d1c71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-2d1c71

openshift-ingress

replicaset-controller

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975

SuccessfulCreate

Created pod: e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-baa504-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

AddedInterface

Add eth0 [10.133.0.197/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-baa504-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-2d1c71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

AddedInterface

Add eth0 [10.132.0.184/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-2d1c71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-2d1c71: serviceaccount "payload-processing-e2e-shared-b-w3-2d1c71" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-2d1c71: serviceaccount "payload-processing-e2e-shared-b-w3-2d1c71" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc

SuccessfulCreate

Created pod: e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

Created

Container created

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w0-68b466

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w0-68b466
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

Started

Container started

openshift-ingress

kubelet

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

ProbeError

Readiness probe error: Get "http://10.133.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-praxis-b-a014d1-openshift-default-566cdcf765-4c97j

Unhealthy

Readiness probe failed: Get "http://10.133.0.148:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-b-w0-68b466-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w0-68b466-openshift-default-57cb5457fc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

AddedInterface

Add eth0 [10.133.0.198/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-68b466: serviceaccount "payload-processing-e2e-shared-b-w0-68b466" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w0-68b466

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w0-68b466-7db5d4cd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w0-68b466: serviceaccount "payload-processing-e2e-shared-b-w0-68b466" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w0-68b466

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

AddedInterface

Add eth0 [10.132.0.185/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

Unhealthy

Startup probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

ProbeError

Startup probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-ef6b56-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-ef6b56-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

Unhealthy

Startup probe failed: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

ProbeError

Startup probe error: Get "http://10.133.0.191:15021/healthz/ready": dial tcp 10.133.0.191:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Unhealthy

Readiness probe failed: Get "http://10.133.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

ProbeError

Readiness probe error: Get "http://10.133.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

Unhealthy

Readiness probe failed: Get "http://10.133.0.195:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

ProbeError

Readiness probe error: Get "http://10.133.0.194:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-explicit-e9ada0-openshift-default-685f6fdbfc

SuccessfulCreate

Created pod: e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

openshift-ingress

gateway_labeler_controller

e2e-explicit-e9ada0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-e9ada0

openshift-ingress

deployment-controller

e2e-explicit-e9ada0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-e9ada0-openshift-default-685f6fdbfc from 0 to 1

openshift-ingress

multus

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

AddedInterface

Add eth0 [10.133.0.202/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-ef6b56-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w4-ef6b56-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

Created

Container created

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-e9ada0-689ff54b78

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-e9ada0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-e9ada0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-e9ada0-689ff54b78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-e9ada0-689ff54b78

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-e9ada0-689ff54b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-e9ada0: serviceaccount "payload-processing-e2e-explicit-e9ada0" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-e9ada0: serviceaccount "payload-processing-e2e-explicit-e9ada0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw

AddedInterface

Add eth0 [10.134.0.108/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh

Created

Container created

openshift-ingress

multus

payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh

AddedInterface

Add eth0 [10.132.0.187/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef6be7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ed012e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ed012e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef6be7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulDelete

Deleted pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-c2e3f9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-c2e3f9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-lk4g2

Killing

Stopping container istio-proxy
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Unhealthy

Startup probe failed: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

ProbeError

Startup probe error: Get "http://10.133.0.194:15021/healthz/ready": dial tcp 10.133.0.194:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

ProbeError

Startup probe error: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

Unhealthy

Startup probe failed: Get "http://10.133.0.195:15021/healthz/ready": dial tcp 10.133.0.195:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff

SuccessfulCreate

Created pod: e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

openshift-ingress

deployment-controller

e2e-shared-a-w2-a1d55d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a1d55d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

Started

Container started

openshift-ingress

multus

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

AddedInterface

Add eth0 [10.133.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Unhealthy

Readiness probe failed: Get "http://10.132.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

ProbeError

Readiness probe error: Get "http://10.132.0.167:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

ProbeError

Readiness probe error: Get "http://10.133.0.197:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

Unhealthy

Readiness probe failed: Get "http://10.133.0.197:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

ProbeError

Startup probe error: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

Unhealthy

Startup probe failed: Get "http://10.133.0.204:15021/healthz/ready": dial tcp 10.133.0.204:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-68b466-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 3 to 4

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulCreate

Created pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-68b466-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

AddedInterface

Add eth0 [10.133.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

Created

Container created

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

Started

Container started

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

ProbeError

Startup probe error: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Unhealthy

Startup probe failed: Get "http://10.132.0.167:15021/healthz/ready": dial tcp 10.132.0.167:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

ProbeError

Startup probe error: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

Unhealthy

Startup probe failed: Get "http://10.133.0.198:15021/healthz/ready": dial tcp 10.133.0.198:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

ProbeError

Startup probe error: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

Unhealthy

Startup probe failed: Get "http://10.133.0.197:15021/healthz/ready": dial tcp 10.133.0.197:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2d1c71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a1d55d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a1d55d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2d1c71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x7)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

ProbeError

Startup probe error: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

Unhealthy

Startup probe failed: Get "http://10.133.0.206:15021/healthz/ready": dial tcp 10.133.0.206:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-68cb9b4b95 from 9 to 8

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-8hjs5

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ed012e-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ed012e-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef6be7-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w2-ef6be7-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-e9ada0-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-explicit-e9ada0-openshift-default-685f6fdbfc

SuccessfulCreate

Created pod: e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

openshift-ingress

replicaset-controller

e2e-explicit-e9ada0-openshift-default-685f6fdbfc

SuccessfulCreate

Created pod: e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

openshift-ingress

deployment-controller

e2e-explicit-e9ada0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-e9ada0-openshift-default-685f6fdbfc from 1 to 4

openshift-ingress

replicaset-controller

e2e-explicit-e9ada0-openshift-default-685f6fdbfc

SuccessfulCreate

Created pod: e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

Created

Container created
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a1d55d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

Started

Container started

openshift-ingress

multus

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

AddedInterface

Add eth0 [10.133.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

Created

Container created

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

AddedInterface

Add eth0 [10.134.0.112/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

Created

Container created

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

Started

Container started
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w2-a1d55d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2d1c71-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2d1c71-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

AddedInterface

Add eth0 [10.132.0.190/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

Started

Container started

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

ProbeError

Readiness probe error: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Unhealthy

Readiness probe failed: Get "http://10.133.0.202:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

ProbeError

Readiness probe error: Get "http://10.133.0.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

Unhealthy

Readiness probe failed: Get "http://10.133.0.192:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

ProbeError

Startup probe error: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

ProbeError

Startup probe error: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

Unhealthy

Startup probe failed: Get "http://10.132.0.190:15021/healthz/ready": dial tcp 10.132.0.190:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

Unhealthy

Startup probe failed: Get "http://10.134.0.112:15021/healthz/ready": dial tcp 10.134.0.112:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

Unhealthy

Startup probe failed: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

ProbeError

Startup probe error: Get "http://10.133.0.207:15021/healthz/ready": dial tcp 10.133.0.207:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-e9ada0-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

ProbeError

Startup probe error: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Unhealthy

Startup probe failed: Get "http://10.133.0.202:15021/healthz/ready": dial tcp 10.133.0.202:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-explicit-e9ada0-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

Unhealthy

Startup probe failed: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

ProbeError

Startup probe error: Get "http://10.133.0.192:15021/healthz/ready": dial tcp 10.133.0.192:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e9ada0-558d6f86bc-wv7fw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-e9ada0-689ff54b78-htzwh

Killing

Stopping container payload-processing
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-68b466-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w0-68b466-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w3-c2e3f9-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w3-c2e3f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc

SuccessfulCreate

Created pod: e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

AddedInterface

Add eth0 [10.134.0.113/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-xsvss

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-f2c9q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-vrq7v

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

AddedInterface

Add eth0 [10.134.0.114/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-noten-754cee-openshift-default-54666dcff9

SuccessfulCreate

Created pod: e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

openshift-ingress

deployment-controller

e2e-noten-754cee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-754cee-openshift-default-54666dcff9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-754cee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-754cee

openshift-ingress

kubelet

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

Created

Container created

openshift-ingress

kubelet

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2d1c71-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-2d1c71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975

SuccessfulCreate

Created pod: e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

openshift-ingress

kubelet

e2e-explicit-e9ada0-openshift-default-685f6fdbfc-kjx6k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

AddedInterface

Add eth0 [10.132.0.191/23] from ovn-kubernetes
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-baa504-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-baa504-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

ProbeError

Startup probe error: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

Unhealthy

Startup probe failed: Get "http://10.134.0.113:15021/healthz/ready": dial tcp 10.134.0.113:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

Unhealthy

Startup probe failed: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

ProbeError

Startup probe error: Get "http://10.132.0.191:15021/healthz/ready": dial tcp 10.132.0.191:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-noten-754cee-openshift-default-54666dcff9-k8xdc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

opendatahub

multus

test-curl-7496-a16491

AddedInterface

Add eth0 [10.132.0.192/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7496-a16491

Started

Container started

opendatahub

kubelet

test-curl-7496-a16491

Created

Container created

opendatahub

kubelet

test-curl-7496-a16491

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7496-2bba09

Created

Container created

opendatahub

multus

test-curl-7496-2bba09

AddedInterface

Add eth0 [10.132.0.193/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7496-2bba09

Started

Container started

opendatahub

kubelet

test-curl-7496-2bba09

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7496-a16491

Killing

Stopping container test-curl-7496-a16491

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-dcd326

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-dcd326

openshift-ingress

replicaset-controller

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f

SuccessfulCreate

Created pod: e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

openshift-ingress

deployment-controller

e2e-shared-a-w1-dcd326-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f from 0 to 1

opendatahub

kubelet

test-curl-7496-2bba09

Killing

Stopping container test-curl-7496-2bba09

openshift-ingress

multus

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

AddedInterface

Add eth0 [10.133.0.210/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-dcd326: serviceaccount "payload-processing-e2e-shared-a-w1-dcd326" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-dcd326

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-dcd326

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-dcd326-76747774b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-dcd326-76747774b6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-dcd326-76747774b6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-dcd326-76747774b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-dcd326: serviceaccount "payload-processing-e2e-shared-a-w1-dcd326" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz

AddedInterface

Add eth0 [10.134.0.117/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj

AddedInterface

Add eth0 [10.134.0.116/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj

Created

Container created

openshift-ingress

replicaset-controller

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5

SuccessfulCreate

Created pod: e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

openshift-ingress

deployment-controller

e2e-shared-b-w1-46385c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-46385c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-46385c

openshift-ingress

multus

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

AddedInterface

Add eth0 [10.133.0.211/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-46385c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-46385c: serviceaccount "payload-processing-e2e-shared-b-w1-46385c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-46385c: serviceaccount "payload-processing-e2e-shared-b-w1-46385c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-46385c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx

AddedInterface

Add eth0 [10.134.0.120/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx

Started

Container started

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw

AddedInterface

Add eth0 [10.134.0.119/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-dcd326-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f

SuccessfulCreate

Created pod: e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

openshift-ingress

deployment-controller

e2e-shared-a-w1-dcd326-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f from 1 to 3

openshift-ingress

replicaset-controller

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f

SuccessfulCreate

Created pod: e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

Started

Container started

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

Started

Container started

openshift-ingress

multus

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

AddedInterface

Add eth0 [10.134.0.121/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

AddedInterface

Add eth0 [10.132.0.195/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

Unhealthy

Readiness probe failed: Get "http://10.133.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

ProbeError

Readiness probe error: Get "http://10.133.0.210:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

Started

Container started
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

ProbeError

Startup probe error: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

ProbeError

Startup probe error: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

Unhealthy

Startup probe failed: Get "http://10.132.0.195:15021/healthz/ready": dial tcp 10.132.0.195:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

Unhealthy

Startup probe failed: Get "http://10.134.0.121:15021/healthz/ready": dial tcp 10.134.0.121:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

Unhealthy

Startup probe failed: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

ProbeError

Startup probe error: Get "http://10.133.0.210:15021/healthz/ready": dial tcp 10.133.0.210:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-a-w0-baa504-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5 from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5

SuccessfulCreate

Created pod: e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-baa504-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

Created

Container created

openshift-ingress

multus

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

AddedInterface

Add eth0 [10.134.0.122/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

Started

Container started
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-dcd326-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-dcd326-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

ProbeError

Startup probe error: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

Unhealthy

Startup probe failed: Get "http://10.134.0.122:15021/healthz/ready": dial tcp 10.134.0.122:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-extmod-a-ca2cd5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-ca2cd5-openshift-default-59664bf6df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-ca2cd5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-ca2cd5

openshift-ingress

replicaset-controller

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df

SuccessfulCreate

Created pod: e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

openshift-ingress

multus

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

AddedInterface

Add eth0 [10.133.0.214/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ca2cd5: serviceaccount "payload-processing-e2e-extmod-a-ca2cd5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-ca2cd5: serviceaccount "payload-processing-e2e-extmod-a-ca2cd5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-ca2cd5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-ca2cd5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-ca2cd5-78bfff4676 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j

AddedInterface

Add eth0 [10.132.0.197/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk

AddedInterface

Add eth0 [10.132.0.196/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-dcd326-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-dcd326-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

openshift-ingress

deployment-controller

e2e-extmod-a-d6f956-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d6f956-openshift-default-56888545df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-d6f956

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-d6f956

openshift-ingress

deployment-controller

e2e-shared-b-w4-ed012e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc from 1 to 2

openshift-ingress

replicaset-controller

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc

SuccessfulCreate

Created pod: e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

AddedInterface

Add eth0 [10.133.0.217/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w4-ed012e-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

Started

Container started

openshift-ingress

multus

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

AddedInterface

Add eth0 [10.132.0.198/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

Created

Container created
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d6f956: serviceaccount "payload-processing-e2e-extmod-a-d6f956" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d6f956-664c46f69b

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-d6f956-664c46f69b

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-d6f956-664c46f69b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-d6f956: serviceaccount "payload-processing-e2e-extmod-a-d6f956" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-d6f956

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-d6f956-664c46f69b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-d6f956

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

AddedInterface

Add eth0 [10.134.0.124/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t

AddedInterface

Add eth0 [10.132.0.199/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

ProbeError

Startup probe error: Get "http://10.132.0.198:15021/healthz/ready": dial tcp 10.132.0.198:15021: connect: connection refused body:

opendatahub

kubelet

test-curl-7505-7a2b92

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

multus

test-curl-7505-7a2b92

AddedInterface

Add eth0 [10.132.0.200/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

Unhealthy

Startup probe failed: Get "http://10.132.0.198:15021/healthz/ready": dial tcp 10.132.0.198:15021: connect: connection refused

opendatahub

kubelet

test-curl-7505-7a2b92

Created

Container created

opendatahub

kubelet

test-curl-7505-7a2b92

Started

Container started

opendatahub

multus

test-curl-7505-297e1b

AddedInterface

Add eth0 [10.132.0.201/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7505-297e1b

Started

Container started

opendatahub

kubelet

test-curl-7505-297e1b

Created

Container created

opendatahub

kubelet

test-curl-7505-297e1b

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7505-7a2b92

Killing

Stopping container test-curl-7505-7a2b92

opendatahub

multus

test-curl-7505-1eea7e

AddedInterface

Add eth0 [10.132.0.202/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7505-1eea7e

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7505-1eea7e

Created

Container created

opendatahub

kubelet

test-curl-7505-1eea7e

Started

Container started

opendatahub

kubelet

test-curl-7505-297e1b

Killing

Stopping container test-curl-7505-297e1b

opendatahub

multus

test-curl-7505-3d0374

AddedInterface

Add eth0 [10.132.0.203/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7505-3d0374

Started

Container started

opendatahub

kubelet

test-curl-7505-3d0374

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7505-3d0374

Created

Container created

opendatahub

kubelet

test-curl-7505-1eea7e

Killing

Stopping container test-curl-7505-1eea7e

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-1dd09d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-1dd09d

opendatahub

kubelet

test-curl-7505-3d0374

Killing

Stopping container test-curl-7505-3d0374

openshift-ingress

deployment-controller

e2e-extmod-a-1dd09d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf from 0 to 1

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

AddedInterface

Add eth0 [10.133.0.219/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-f3d6a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-f3d6a5

openshift-ingress

deployment-controller

e2e-extmod-b-f3d6a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w3-2d1c71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975 from 2 to 3

openshift-ingress

replicaset-controller

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975

SuccessfulCreate

Created pod: e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2d1c71-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

AddedInterface

Add eth0 [10.133.0.221/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

Started

Container started

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

AddedInterface

Add eth0 [10.134.0.126/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

Created

Container created

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-46385c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1dd09d: serviceaccount "payload-processing-e2e-extmod-a-1dd09d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-1dd09d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-1dd09d: serviceaccount "payload-processing-e2e-extmod-a-1dd09d" not found

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-46385c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-1dd09d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m

Created

Container created

openshift-ingress

multus

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m

AddedInterface

Add eth0 [10.132.0.205/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

AddedInterface

Add eth0 [10.132.0.204/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

Created

Container created

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-f3d6a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-f3d6a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f3d6a5: serviceaccount "payload-processing-e2e-extmod-b-f3d6a5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-f3d6a5: serviceaccount "payload-processing-e2e-extmod-b-f3d6a5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

AddedInterface

Add eth0 [10.132.0.207/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw

AddedInterface

Add eth0 [10.132.0.206/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

ProbeError

Startup probe error: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

Unhealthy

Startup probe failed: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

ProbeError

Startup probe error: Get "http://10.134.0.126:15021/healthz/ready": dial tcp 10.134.0.126:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-v6lzz
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

Unhealthy

Startup probe failed: Get "http://10.133.0.211:15021/healthz/ready": dial tcp 10.133.0.211:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 10 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 10 to 9

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-dhv28

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-ltn6z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-extmod-a-e51c10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e51c10-openshift-default-54b5584fb5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-e51c10

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-e51c10

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

AddedInterface

Add eth0 [10.133.0.222/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-4a477d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-4a477d

openshift-ingress

multus

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

AddedInterface

Add eth0 [10.133.0.223/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-4a477d-openshift-default-66bfdb8649

SuccessfulCreate

Created pod: e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

openshift-ingress

deployment-controller

e2e-extmod-b-4a477d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-4a477d-openshift-default-66bfdb8649 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-e51c10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-e51c10-54cbdf79f4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-e51c10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e51c10: serviceaccount "payload-processing-e2e-extmod-a-e51c10" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-e51c10: serviceaccount "payload-processing-e2e-extmod-a-e51c10" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

AddedInterface

Add eth0 [10.132.0.210/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

AddedInterface

Add eth0 [10.132.0.211/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

opendatahub

multus

test-curl-7493-f4531f

AddedInterface

Add eth0 [10.132.0.212/23] from ovn-kubernetes

opendatahub

kubelet

test-curl-7493-f4531f

Started

Container started

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

Started

Container started

opendatahub

kubelet

test-curl-7493-f4531f

Created

Container created

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-wrkgn

Killing

Stopping container istio-proxy

opendatahub

kubelet

test-curl-7493-f4531f

Pulled

Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

Started

Container started

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4a477d-6d8d59f968

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4a477d: serviceaccount "payload-processing-e2e-extmod-b-4a477d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-4a477d-6d8d59f968

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-4a477d-6d8d59f968-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-4a477d: serviceaccount "payload-processing-e2e-extmod-b-4a477d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-4a477d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-4a477d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-4a477d-6d8d59f968 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

AddedInterface

Add eth0 [10.134.0.127/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n

AddedInterface

Add eth0 [10.134.0.128/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

opendatahub

kubelet

test-curl-7493-f4531f

Killing

Stopping container test-curl-7493-f4531f
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

Started

Container started
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-46385c-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w1-46385c-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-e67d95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-e67d95

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ca2cd5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ca2cd5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

e2e-extmod-b-e67d95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e67d95-openshift-default-7db5c6f57c from 0 to 1

openshift-ingress

replicaset-controller

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c

SuccessfulCreate

Created pod: e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

openshift-ingress

multus

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

AddedInterface

Add eth0 [10.133.0.226/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

ProbeError

Startup probe error: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

Unhealthy

Startup probe failed: Get "http://10.133.0.214:15021/healthz/ready": dial tcp 10.133.0.214:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e67d95-944b9d9d

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-e67d95-944b9d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e67d95: serviceaccount "payload-processing-e2e-extmod-b-e67d95" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-e67d95: serviceaccount "payload-processing-e2e-extmod-b-e67d95" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-e67d95-944b9d9d

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-e67d95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-e67d95-8b4987555 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-e67d95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-e67d95-944b9d9d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

AddedInterface

Add eth0 [10.132.0.214/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

Started

Container started

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

Created

Container created

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

AddedInterface

Add eth0 [10.134.0.130/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 10 to 9

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 9; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

openshift-ingress

deployment-controller

e2e-autores-c164d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-c164d6-openshift-default-74c7bf49f9 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-c164d6-openshift-default-74c7bf49f9

SuccessfulCreate

Created pod: e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

openshift-ingress

gateway_labeler_controller

e2e-autores-c164d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-c164d6

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-9kwws

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

AddedInterface

Add eth0 [10.133.0.227/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-7njf5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulDelete

Deleted pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-nbpps

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulDelete

Deleted pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 10 to 8

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-m49gp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c164d6-7b8dc947d8

SuccessfulCreate

Created pod: payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j
(x4)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-c164d6-7b8dc947d8

FailedCreate

Error creating: pods "payload-processing-e2e-autores-c164d6-7b8dc947d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c164d6: serviceaccount "payload-processing-e2e-autores-c164d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-c164d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-c164d6-6d4885c779 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-c164d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-c164d6-7b8dc947d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c164d6-6d4885c779

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-c164d6-6d4885c779

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-c164d6-6d4885c779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-c164d6: serviceaccount "payload-processing-e2e-autores-c164d6" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j

Started

Container started

openshift-ingress

multus

payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j

AddedInterface

Add eth0 [10.132.0.216/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs

AddedInterface

Add eth0 [10.134.0.131/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7

SuccessfulCreate

Created pod: e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulCreate

Created pod: istiod-openshift-gateway-7ddd9cfdc8-wlrxd

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-extmod-b-28c1e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7 from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

AddedInterface

Add eth0 [10.133.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-28c1e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-28c1e9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 3 to 4

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

Started

Container started

openshift-ingress

multus

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

AddedInterface

Add eth0 [10.132.0.217/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

Created

Container created

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gz2dg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

Unhealthy

Readiness probe failed: Get "http://10.133.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-l954s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

ProbeError

Readiness probe error: Get "http://10.133.0.222:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 8 to 7

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulDelete

Deleted pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-p4w5s

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ca2cd5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-ca2cd5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-ghbmk
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-28c1e9-764f79d546

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-28c1e9-764f79d546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-28c1e9: serviceaccount "payload-processing-e2e-extmod-b-28c1e9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-28c1e9-764f79d546

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-28c1e9: serviceaccount "payload-processing-e2e-extmod-b-28c1e9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-28c1e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-28c1e9-764f79d546 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-28c1e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

AddedInterface

Add eth0 [10.132.0.219/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

Started

Container started

openshift-ingress

multus

payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l

AddedInterface

Add eth0 [10.132.0.220/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l

Started

Container started

openshift-ingress

deployment-controller

e2e-extmod-b-f3d6a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7 from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f3d6a5-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

AddedInterface

Add eth0 [10.134.0.132/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5

SuccessfulCreate

Created pod: e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-baa504-openshift-default

SuccessfulRescale

New size: 3; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-shared-a-w0-baa504-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5 from 2 to 3

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

AddedInterface

Add eth0 [10.132.0.222/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

AddedInterface

Add eth0 [10.134.0.133/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

Created

Container created

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

Started

Container started

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e51c10-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

openshift-ingress

deployment-controller

e2e-extmod-a-e51c10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e51c10-openshift-default-54b5584fb5 from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

openshift-ingress

multus

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

AddedInterface

Add eth0 [10.132.0.224/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

Created

Container created

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

AddedInterface

Add eth0 [10.134.0.134/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

Unhealthy

Readiness probe failed: Get "http://10.133.0.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

ProbeError

Readiness probe error: Get "http://10.133.0.221:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

Created

Container created

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

AddedInterface

Add eth0 [10.134.0.135/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

Created

Container created

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

AddedInterface

Add eth0 [10.132.0.225/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

Started

Container started
(x2)

cert-manager

kubelet

cert-manager-webhook-5dbbbf75cc-cjqh2

Unhealthy

Readiness probe failed: Get "http://10.134.0.25:6080/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9
(x6)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

ProbeError

Startup probe error: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

ProbeError

Startup probe error: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

Unhealthy

Startup probe failed: Get "http://10.134.0.133:15021/healthz/ready": dial tcp 10.134.0.133:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

Unhealthy

Startup probe failed: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

ProbeError

Startup probe error: Get "http://10.134.0.132:15021/healthz/ready": dial tcp 10.134.0.132:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

Unhealthy

Startup probe failed: Get "http://10.132.0.222:15021/healthz/ready": dial tcp 10.132.0.222:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

Unhealthy

Startup probe failed: Get "http://10.132.0.225:15021/healthz/ready": dial tcp 10.132.0.225:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

Unhealthy

Startup probe failed: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e67d95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e67d95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

ProbeError

Startup probe error: Get "http://10.133.0.222:15021/healthz/ready": dial tcp 10.133.0.222:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

ProbeError

Startup probe error: Get "http://10.132.0.225:15021/healthz/ready": dial tcp 10.132.0.225:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

ProbeError

Startup probe error: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

Unhealthy

Startup probe failed: Get "http://10.133.0.221:15021/healthz/ready": dial tcp 10.133.0.221:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

Unhealthy

Startup probe failed: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

Unhealthy

Startup probe failed: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

Unhealthy

Startup probe failed: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

ProbeError

Startup probe error: Get "http://10.132.0.224:15021/healthz/ready": dial tcp 10.132.0.224:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

ProbeError

Startup probe error: Get "http://10.134.0.134:15021/healthz/ready": dial tcp 10.134.0.134:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

ProbeError

Startup probe error: Get "http://10.134.0.135:15021/healthz/ready": dial tcp 10.134.0.135:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-qn4s9

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e51c10-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e51c10-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-28c1e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-28c1e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c164d6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c164d6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f3d6a5-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f3d6a5-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e51c10-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e51c10-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

Unhealthy

Readiness probe failed: Get "http://10.133.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

ProbeError

Readiness probe error: Get "http://10.133.0.223:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

ProbeError

Readiness probe error: Get "http://10.133.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Unhealthy

Readiness probe failed: Get "http://10.133.0.226:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-extmod-b-f3d6a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7 from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f3d6a5-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

Created

Container created

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

AddedInterface

Add eth0 [10.132.0.227/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

AddedInterface

Add eth0 [10.132.0.226/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

openshift-ingress

deployment-controller

e2e-extmod-a-e51c10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e51c10-openshift-default-54b5584fb5 from 4 to 8

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

AddedInterface

Add eth0 [10.133.0.229/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

AddedInterface

Add eth0 [10.133.0.230/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

AddedInterface

Add eth0 [10.133.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

Created

Container created

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

AddedInterface

Add eth0 [10.132.0.228/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

Started

Container started

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

AddedInterface

Add eth0 [10.134.0.140/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

AddedInterface

Add eth0 [10.133.0.231/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

ProbeError

Startup probe error: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4a477d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x7)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

Unhealthy

Startup probe failed: Get "http://10.133.0.223:15021/healthz/ready": dial tcp 10.133.0.223:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4a477d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

AddedInterface

Add eth0 [10.134.0.142/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

Started

Container started

openshift-ingress

deployment-controller

e2e-autores-c164d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-c164d6-openshift-default-74c7bf49f9 from 1 to 4

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

Created

Container created

openshift-ingress

multus

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

AddedInterface

Add eth0 [10.134.0.141/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-c164d6-openshift-default-74c7bf49f9

SuccessfulCreate

Created pod: e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c164d6-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-autores-c164d6-openshift-default-74c7bf49f9

SuccessfulCreate

Created pod: e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

openshift-ingress

replicaset-controller

e2e-autores-c164d6-openshift-default-74c7bf49f9

SuccessfulCreate

Created pod: e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

Created

Container created

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

Started

Container started

openshift-ingress

replicaset-controller

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c

SuccessfulCreate

Created pod: e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

openshift-ingress

replicaset-controller

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c

SuccessfulCreate

Created pod: e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

openshift-ingress

replicaset-controller

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c

SuccessfulCreate

Created pod: e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

ProbeError

Startup probe error: Get "http://10.132.0.227:15021/healthz/ready": dial tcp 10.132.0.227:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

ProbeError

Startup probe error: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e67d95-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-b-e67d95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e67d95-openshift-default-7db5c6f57c from 1 to 4

llm

kubelet

e2e-distinct-simulated-kserve-7b998b79d9-zgw99

Unhealthy

Readiness probe failed: Get "https://10.133.0.44:8000/ready": context deadline exceeded
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

Unhealthy

Startup probe failed: Get "http://10.132.0.226:15021/healthz/ready": dial tcp 10.132.0.226:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

Unhealthy

Startup probe failed: Get "http://10.132.0.227:15021/healthz/ready": dial tcp 10.132.0.227:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

AddedInterface

Add eth0 [10.134.0.143/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

ProbeError

Startup probe error: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

Unhealthy

Startup probe failed: Get "http://10.134.0.140:15021/healthz/ready": dial tcp 10.134.0.140:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

Unhealthy

Startup probe failed: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

ProbeError

Startup probe error: Get "http://10.132.0.228:15021/healthz/ready": dial tcp 10.132.0.228:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

AddedInterface

Add eth0 [10.134.0.144/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

ProbeError

Startup probe error: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

Unhealthy

Startup probe failed: Get "http://10.133.0.229:15021/healthz/ready": dial tcp 10.133.0.229:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

Unhealthy

Startup probe failed: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

ProbeError

Startup probe error: Get "http://10.133.0.230:15021/healthz/ready": dial tcp 10.133.0.230:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

AddedInterface

Add eth0 [10.133.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

ProbeError

Readiness probe error: Get "http://10.133.0.226:15021/healthz/ready": read tcp 10.133.0.2:56482->10.133.0.226:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Unhealthy

Readiness probe failed: Get "http://10.133.0.226:15021/healthz/ready": read tcp 10.133.0.2:56482->10.133.0.226:15021: read: connection reset by peer
(x9)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

Unhealthy

Startup probe failed: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused
(x9)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

Unhealthy

Startup probe failed: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x9)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

ProbeError

Startup probe error: Get "http://10.133.0.231:15021/healthz/ready": dial tcp 10.133.0.231:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

ProbeError

Startup probe error: Get "http://10.133.0.232:15021/healthz/ready": dial tcp 10.133.0.232:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f3d6a5-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

AddedInterface

Add eth0 [10.133.0.235/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx
(x8)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": dial tcp 10.134.0.141:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Created

Container created

openshift-ingress

deployment-controller

e2e-extmod-b-f3d6a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7 from 8 to 10

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulCreate

Created pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7
(x7)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": dial tcp 10.134.0.142:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

Started

Container started

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

ProbeError

Startup probe error: Get "http://10.134.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-extmod-a-e51c10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-e51c10-openshift-default-54b5584fb5 from 8 to 10

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e51c10-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

ProbeError

Startup probe error: Get "http://10.134.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

Unhealthy

Startup probe failed: Get "http://10.134.0.142:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

Unhealthy

Startup probe failed: Get "http://10.134.0.141:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

AddedInterface

Add eth0 [10.134.0.145/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

AddedInterface

Add eth0 [10.133.0.236/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

AddedInterface

Add eth0 [10.134.0.146/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

ProbeError

Startup probe error: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

Unhealthy

Startup probe failed: Get "http://10.134.0.143:15021/healthz/ready": dial tcp 10.134.0.143:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

Created

Container created
(x9)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

ProbeError

Startup probe error: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

Unhealthy

Startup probe failed: Get "http://10.134.0.144:15021/healthz/ready": dial tcp 10.134.0.144:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Unhealthy

Startup probe failed: Get "http://10.133.0.234:15021/healthz/ready": dial tcp 10.133.0.234:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

ProbeError

Startup probe error: Get "http://10.133.0.234:15021/healthz/ready": dial tcp 10.133.0.234:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-autores-c164d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-c164d6-openshift-default-74c7bf49f9 from 4 to 6

openshift-ingress

replicaset-controller

e2e-autores-c164d6-openshift-default-74c7bf49f9

SuccessfulCreate

Created pod: e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

openshift-ingress

replicaset-controller

e2e-autores-c164d6-openshift-default-74c7bf49f9

SuccessfulCreate

Created pod: e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c164d6-openshift-default

SuccessfulRescale

New size: 6; reason:
(x8)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Unhealthy

Startup probe failed: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

AddedInterface

Add eth0 [10.133.0.237/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

ProbeError

Readiness probe error: Get "http://10.132.0.217:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

Unhealthy

Readiness probe failed: Get "http://10.132.0.217:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

ProbeError

Startup probe error: Get "http://10.133.0.226:15021/healthz/ready": dial tcp 10.133.0.226:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

Unhealthy

Startup probe failed: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

ProbeError

Startup probe error: Get "http://10.133.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

ProbeError

Startup probe error: Get "http://10.133.0.235:15021/healthz/ready": dial tcp 10.133.0.235:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-c164d6-6d4885c779-255gs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

Started

Container started

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Unhealthy

Startup probe failed: Get "http://10.133.0.234:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

ProbeError

Readiness probe error: Get "http://10.133.0.227:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x3)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

Unhealthy

Readiness probe failed: Get "http://10.133.0.227:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x7)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

Unhealthy

Startup probe failed: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

ProbeError

Startup probe error: Get "http://10.134.0.145:15021/healthz/ready": dial tcp 10.134.0.145:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

ProbeError

Startup probe error: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

Unhealthy

Startup probe failed: Get "http://10.134.0.146:15021/healthz/ready": dial tcp 10.134.0.146:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

ProbeError

Startup probe error: Get "http://10.133.0.236:15021/healthz/ready": dial tcp 10.133.0.236:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

Unhealthy

Startup probe failed: Get "http://10.133.0.236:15021/healthz/ready": dial tcp 10.133.0.236:15021: connect: connection refused

openshift-ingress

multus

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

AddedInterface

Add eth0 [10.134.0.147/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

Created

Container created

openshift-ingress

multus

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

AddedInterface

Add eth0 [10.132.0.229/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

Started

Container started

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

Created

Container created

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-autores-c164d6-7b8dc947d8-fmg5j

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.216:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

Unhealthy

Startup probe failed: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

ProbeError

Startup probe error: Get "http://10.133.0.237:15021/healthz/ready": dial tcp 10.133.0.237:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

Unhealthy

Startup probe failed: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

ProbeError

Startup probe error: Get "http://10.132.0.217:15021/healthz/ready": dial tcp 10.132.0.217:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4a477d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4a477d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

Created

Container created
(x2)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

ProbeError

Startup probe error: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

Unhealthy

Startup probe failed: Get "http://10.134.0.147:15021/healthz/ready": dial tcp 10.134.0.147:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

Started

Container started

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

ProbeError

Startup probe error: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

Unhealthy

Startup probe failed: Get "http://10.132.0.229:15021/healthz/ready": dial tcp 10.132.0.229:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-27pwc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-pp2sm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-jh2jf

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c164d6-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-autores-c164d6-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-autores-c164d6-openshift-default-dockercfg-c42sr); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-autores-c164d6-openshift-default-dockercfg-c42sr); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4z45n

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e67d95-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

Unhealthy

Startup probe failed: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

ProbeError

Startup probe error: Get "http://10.133.0.227:15021/healthz/ready": dial tcp 10.133.0.227:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e67d95-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-4dd4v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-c164d6-openshift-default-74c7bf49f9-75qr6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7

SuccessfulCreate

Created pod: e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

openshift-ingress

gateway_labeler_controller

e2e-extmod-a-37f2b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-a-37f2b8

openshift-ingress

deployment-controller

e2e-extmod-a-37f2b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7 from 0 to 1

openshift-ingress

multus

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

AddedInterface

Add eth0 [10.134.0.148/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-a-37f2b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-37f2b8: serviceaccount "payload-processing-e2e-extmod-a-37f2b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-a-37f2b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-a-37f2b8: serviceaccount "payload-processing-e2e-extmod-a-37f2b8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7

Created

Container created

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7

AddedInterface

Add eth0 [10.132.0.231/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f

AddedInterface

Add eth0 [10.132.0.230/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-extmod-b-e67d95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-e67d95-openshift-default-7db5c6f57c from 4 to 7

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-e67d95-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c

SuccessfulCreate

Created pod: e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

openshift-ingress

replicaset-controller

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c

SuccessfulCreate

Created pod: e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

openshift-ingress

replicaset-controller

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c

SuccessfulCreate

Created pod: e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

Created

Container created

openshift-ingress

multus

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

AddedInterface

Add eth0 [10.133.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

AddedInterface

Add eth0 [10.132.0.232/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

Started

Container started

openshift-ingress

multus

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

AddedInterface

Add eth0 [10.134.0.149/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

Unhealthy

Startup probe failed: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

Unhealthy

Startup probe failed: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

ProbeError

Startup probe error: Get "http://10.132.0.232:15021/healthz/ready": dial tcp 10.132.0.232:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

ProbeError

Startup probe error: Get "http://10.134.0.149:15021/healthz/ready": dial tcp 10.134.0.149:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

ProbeError

Startup probe error: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

Unhealthy

Startup probe failed: Get "http://10.133.0.238:15021/healthz/ready": dial tcp 10.133.0.238:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-28c1e9-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-28c1e9-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37f2b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37f2b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

e2e-extmod-b-ecc266-openshift-default-68bdc475d9

SuccessfulCreate

Created pod: e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

openshift-ingress

deployment-controller

e2e-extmod-b-ecc266-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-ecc266-openshift-default-68bdc475d9 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-extmod-b-ecc266

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-extmod-b-ecc266

openshift-ingress

multus

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

AddedInterface

Add eth0 [10.132.0.233/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ecc266-76b554bcc6

SuccessfulCreate

Created pod: payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

openshift-ingress

deployment-controller

payload-processing-e2e-extmod-b-ecc266

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-extmod-b-ecc266-76b554bcc6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-extmod-b-ecc266-76b554bcc6

FailedCreate

Error creating: pods "payload-processing-e2e-extmod-b-ecc266-76b554bcc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ecc266: serviceaccount "payload-processing-e2e-extmod-b-ecc266" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-extmod-b-ecc266

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c

SuccessfulCreate

Created pod: payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c

FailedCreate

Error creating: pods "payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-extmod-b-ecc266: serviceaccount "payload-processing-e2e-extmod-b-ecc266" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr

Created

Container created

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr

Started

Container started

openshift-ingress

multus

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr

AddedInterface

Add eth0 [10.133.0.240/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

Created

Container created
(x6)

openshift-ingress

kubelet

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

Unhealthy

Startup probe failed: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

ProbeError

Startup probe error: Get "http://10.134.0.148:15021/healthz/ready": dial tcp 10.134.0.148:15021: connect: connection refused body:
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37f2b8-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-37f2b8-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x19)

llm

kubelet

premium-simulated-simulated-premium-kserve-5f5c4b459f-v6bvb

Unhealthy

Readiness probe failed: Get "https://10.133.0.47:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1dd09d-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

deployment-controller

e2e-extmod-a-1dd09d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

Unhealthy

Readiness probe failed: Get "http://10.133.0.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

ProbeError

Readiness probe error: Get "http://10.133.0.219:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-extmod-b-4a477d-openshift-default-66bfdb8649

SuccessfulCreate

Created pod: e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

openshift-ingress

deployment-controller

e2e-extmod-b-4a477d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-b-4a477d-openshift-default-66bfdb8649 from 1 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-4a477d-openshift-default

SuccessfulRescale

New size: 2; reason: cpu resource utilization (percentage of request) above target
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

Created

Container created
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1dd09d-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1dd09d-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

Unhealthy

Startup probe failed: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

ProbeError

Startup probe error: Get "http://10.133.0.219:15021/healthz/ready": dial tcp 10.133.0.219:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

openshift-ingress

deployment-controller

e2e-extmod-a-1dd09d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf from 4 to 8

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1dd09d-openshift-default

SuccessfulRescale

New size: 8; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-1dd09d-openshift-default

SuccessfulRescale

New size: 10; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf

SuccessfulCreate

Created pod: e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

openshift-ingress

deployment-controller

e2e-extmod-a-1dd09d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf from 8 to 10

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

Pulled

Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod

openshift-ingress

multus

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

AddedInterface

Add eth0 [10.134.0.155/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

Started

Container started

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

Created

Container created

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-wmh65

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulDelete

Deleted pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 7 to 6

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-zvv2m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

Unhealthy

Readiness probe failed: Get "http://10.133.0.217:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

ProbeError

Readiness probe error: Get "http://10.133.0.217:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-qv6r8

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

Started

Container started

openshift-ingress

deployment-controller

e2e-shared-b-w3-2d1c71-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975 from 3 to 2

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-b-w3-2d1c71-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975

SuccessfulDelete

Deleted pod: e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-d6cfq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

AddedInterface

Add eth0 [10.133.0.250/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

Created

Container created

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

AddedInterface

Add eth0 [10.133.0.251/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x3)

openshift-ingress

deployment-controller

e2e-worker-w3-2889dd-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w3-2889dd-openshift-default-84768d69f7 from 6 to 5

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulDelete

Deleted pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-l5fqv

openshift-ingress

deployment-controller

e2e-extmod-a-e51c10-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-a-e51c10-openshift-default-54b5584fb5 from 10 to 8
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-e51c10-openshift-default

SuccessfulRescale

New size: 8; reason: All metrics below target

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w3-2889dd-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

replicaset-controller

e2e-extmod-a-e51c10-openshift-default-54b5584fb5

SuccessfulDelete

Deleted pod: e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

openshift-ingress

replicaset-controller

e2e-worker-w3-2889dd-openshift-default-84768d69f7

SuccessfulDelete

Deleted pod: e2e-worker-w3-2889dd-openshift-default-84768d69f7-bpjw4
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-8wnxx

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w1-dcd326-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

deployment-controller

e2e-shared-a-w1-dcd326-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f from 3 to 2

openshift-ingress

replicaset-controller

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f

SuccessfulDelete

Deleted pod: e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-rvcsw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

Started

Container started

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

AddedInterface

Add eth0 [10.134.0.160/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-68cb9b4b95-dhclt

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-dhclt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-68cb9b4b95 from 8 to 7
(x3)

openshift-ingress

deployment-controller

e2e-worker-w2-39bde3-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w2-39bde3-openshift-default-5d45cdbd49 from 6 to 4

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-6pb9d

openshift-ingress

replicaset-controller

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49

SuccessfulDelete

Deleted pod: e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-9dgtr

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w2-39bde3-openshift-default

SuccessfulRescale

New size: 4; reason: All metrics below target
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

ProbeError

Startup probe error: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

Unhealthy

Startup probe failed: Get "http://10.133.0.251:15021/healthz/ready": dial tcp 10.133.0.251:15021: connect: connection refused

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

AddedInterface

Add eth0 [10.134.0.161/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w0-9de872-openshift-default

SuccessfulRescale

New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w0-9de872-openshift-default-77cf8df555

SuccessfulDelete

Deleted pod: e2e-worker-w0-9de872-openshift-default-77cf8df555-5hp6d

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

Started

Container started

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

AddedInterface

Add eth0 [10.134.0.162/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x8)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

ProbeError

Startup probe error: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

Unhealthy

Startup probe failed: Get "http://10.133.0.250:15021/healthz/ready": dial tcp 10.133.0.250:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-9de872-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w0-9de872-openshift-default-77cf8df555 from 6 to 5

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

Started

Container started

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

AddedInterface

Add eth0 [10.133.0.253/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-0458df-openshift-default-7c86d79f79

SuccessfulDelete

Deleted pod: e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

Unhealthy

Startup probe failed: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused
(x2)

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

SuccessfulRescale

New size: 3; reason: All metrics below target
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

ProbeError

Startup probe error: Get "http://10.133.0.217:15021/healthz/ready": dial tcp 10.133.0.217:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x4)

openshift-ingress

deployment-controller

e2e-worker-w4-0458df-openshift-default

ScalingReplicaSet

(combined from similar events): Scaled down replica set e2e-worker-w4-0458df-openshift-default-7c86d79f79 from 6 to 5

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 4 to 3

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w4-0458df-openshift-default

SuccessfulRescale

(combined from similar events): New size: 5; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-857g4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulDelete

Deleted pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-229cp
(x5)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

Unhealthy

Startup probe failed: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

ProbeError

Startup probe error: Get "http://10.134.0.160:15021/healthz/ready": dial tcp 10.134.0.160:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

Created

Container created

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

AddedInterface

Add eth0 [10.133.0.255/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

Created

Container created

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

AddedInterface

Add eth0 [10.132.0.234/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

Started

Container started

openshift-ingress

multus

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

AddedInterface

Add eth0 [10.133.1.0/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

multus

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

AddedInterface

Add eth0 [10.132.0.235/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

Unhealthy

Startup probe failed: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

ProbeError

Startup probe error: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

Unhealthy

Startup probe failed: Get "http://10.134.0.161:15021/healthz/ready": dial tcp 10.134.0.161:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

Created

Container created

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x6)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

ProbeError

Startup probe error: Get "http://10.134.0.162:15021/healthz/ready": dial tcp 10.134.0.162:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

Started

Container started
(x8)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

ProbeError

Startup probe error: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

Unhealthy

Startup probe failed: Get "http://10.133.0.253:15021/healthz/ready": dial tcp 10.133.0.253:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

Unhealthy

Startup probe failed: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

ProbeError

Startup probe error: Get "http://10.132.0.234:15021/healthz/ready": dial tcp 10.132.0.234:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

ProbeError

Startup probe error: Get "http://10.133.1.0:15021/healthz/ready": dial tcp 10.133.1.0:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

Unhealthy

Startup probe failed: Get "http://10.133.1.0:15021/healthz/ready": dial tcp 10.133.1.0:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

Unhealthy

Startup probe failed: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

ProbeError

Startup probe error: Get "http://10.132.0.235:15021/healthz/ready": dial tcp 10.132.0.235:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

ProbeError

Startup probe error: Get "http://10.133.0.255:15021/healthz/ready": dial tcp 10.133.0.255:15021: connect: connection refused body:
(x9)

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

Unhealthy

Startup probe failed: Get "http://10.133.0.255:15021/healthz/ready": dial tcp 10.133.0.255:15021: connect: connection refused
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d6f956-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d6f956-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-37f2b8-d57c6cb9f-wd9s7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-37f2b8-7797c9b5d8-qln5f

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5

SuccessfulDelete

Deleted pod: e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

openshift-ingress

horizontal-pod-autoscaler

e2e-shared-a-w0-baa504-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-bbj79

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w0-baa504-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5 from 3 to 2

openshift-ingress

deployment-controller

e2e-extmod-a-d6f956-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d6f956-openshift-default-56888545df from 1 to 4

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d6f956-openshift-default

SuccessfulRescale

New size: 4; reason: cpu resource utilization (percentage of request) above target

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

Created

Container created

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

AddedInterface

Add eth0 [10.133.1.2/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

Started

Container started
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
(x2)

openshift-ingress

kubelet

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

Started

Container started

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

AddedInterface

Add eth0 [10.134.0.163/23] from ovn-kubernetes

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

AddedInterface

Add eth0 [10.132.0.237/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

ProbeError

Startup probe error: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

Unhealthy

Startup probe failed: Get "http://10.134.0.163:15021/healthz/ready": dial tcp 10.134.0.163:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

Unhealthy

Startup probe failed: Get "http://10.133.1.2:15021/healthz/ready": dial tcp 10.133.1.2:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

ProbeError

Startup probe error: Get "http://10.133.1.2:15021/healthz/ready": dial tcp 10.133.1.2:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

Unhealthy

Startup probe failed: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

Unhealthy

Startup probe failed: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

ProbeError

Startup probe error: Get "http://10.132.0.233:15021/healthz/ready": dial tcp 10.132.0.233:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

ProbeError

Startup probe error: Get "http://10.132.0.237:15021/healthz/ready": dial tcp 10.132.0.237:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-37f2b8-openshift-default-8fdbcc5c7-clns5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d6f956-openshift-default

SuccessfulRescale

New size: 8; reason:

openshift-ingress

deployment-controller

e2e-extmod-a-d6f956-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d6f956-openshift-default-56888545df from 4 to 8

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

Started

Container started

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

AddedInterface

Add eth0 [10.133.1.6/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

Created

Container created
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ecc266-openshift-default

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-ecc266-openshift-default

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

AddedInterface

Add eth0 [10.134.0.164/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

Started

Container started
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

ProbeError

Startup probe error: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

Unhealthy

Startup probe failed: Get "http://10.133.1.6:15021/healthz/ready": dial tcp 10.133.1.6:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-ecc266-68f9ddc76c-2whjr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-ecc266-76b554bcc6-ttpkn

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

Unhealthy

Startup probe failed: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

ProbeError

Startup probe error: Get "http://10.134.0.164:15021/healthz/ready": dial tcp 10.134.0.164:15021: connect: connection refused body:

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

AddedInterface

Add eth0 [10.133.1.8/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

Started

Container started

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

Started

Container started

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

AddedInterface

Add eth0 [10.134.0.166/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

openshift-ingress

replicaset-controller

e2e-extmod-a-d6f956-openshift-default-56888545df

SuccessfulCreate

(combined from similar events): Created pod: e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-a-d6f956-openshift-default

SuccessfulRescale

New size: 10; reason:

openshift-ingress

deployment-controller

e2e-extmod-a-d6f956-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-extmod-a-d6f956-openshift-default-56888545df from 8 to 10

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

AddedInterface

Add eth0 [10.133.1.9/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

Unhealthy

Startup probe failed: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

ProbeError

Startup probe error: Get "http://10.134.0.166:15021/healthz/ready": dial tcp 10.134.0.166:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

Unhealthy

Startup probe failed: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

ProbeError

Startup probe error: Get "http://10.133.1.8:15021/healthz/ready": dial tcp 10.133.1.8:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

Started

Container started

openshift-ingress

multus

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

AddedInterface

Add eth0 [10.132.0.238/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

Created

Container created

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

Started

Container started

openshift-ingress

kubelet

e2e-extmod-b-ecc266-openshift-default-68bdc475d9-cdvjh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-spj2d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-mzg74

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-s52kx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-rg24b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-cqzrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-9v7v9

Killing

Stopping container istio-proxy
(x9)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

ProbeError

Startup probe error: Get "http://10.133.1.9:15021/healthz/ready": dial tcp 10.133.1.9:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-zp9hw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
(x9)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

Unhealthy

Startup probe failed: Get "http://10.133.1.9:15021/healthz/ready": dial tcp 10.133.1.9:15021: connect: connection refused

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-jv2tm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-96zzd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-1dd09d-openshift-default-7477c8cdbf-d7mth

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

ProbeError

Startup probe error: Get "http://10.132.0.238:15021/healthz/ready": dial tcp 10.132.0.238:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

Unhealthy

Startup probe failed: Get "http://10.132.0.238:15021/healthz/ready": dial tcp 10.132.0.238:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-1dd09d-6f8fd8d8ff-7fkdb

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-1dd09d-6fdfc749bd-w5q6m

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w0-baa504-649698ff67-7xrxq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w0-baa504-7ff6d9c654-4bns5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-sm85b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-vftmm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-9bth7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-c4g4h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-txmmt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-lkl5j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-twb72

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-e51c10-openshift-default-54b5584fb5-tvbgw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cv8pb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-85m94

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-lh7n5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-mfdt7

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-e67d95-8b4987555-hgkf7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-e51c10-54cbdf79f4-wkpq2

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-e51c10-84d8cf95c5-ncgpf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-cp6fh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-e67d95-944b9d9d-v24xd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-qlfsm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-99fmr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-b-e67d95-openshift-default-7db5c6f57c-g55d7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w0-baa504-openshift-default-6944b9c4d5-xtlxh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-28c1e9-openshift-default-6cf9f44bc7-kqjmt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-d6f956-6cd456fccf-mtrqj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-d6f956-664c46f69b-hzl8t

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

Unhealthy

Readiness probe failed: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w4-ef6b56-openshift-default-768647479-wp2lf

ProbeError

Readiness probe error: Get "http://10.132.0.166:15021/healthz/ready": dial tcp 10.132.0.166:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-ftq7b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-c8mzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-28c1e9-7f799964f5-gfmv4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w0-68b466-openshift-default-57cb5457fc-jgkhq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2xr45

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-5hdmh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-ef6b56-db5bbb6bc-bxlwd

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-pzhn5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-28c1e9-764f79d546-jml8l

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-s86lp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-ef6b56-68548b9ccb-wvwkx

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-gnb5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-2cf46

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-6crc4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w0-68b466-7db5d4cd-j47fp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-d6f956-openshift-default-56888545df-n58tr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w0-68b466-594d77b4c-nfjqn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-clvlk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-c2e3f9-openshift-default-697cdcbdfc-qwqmg

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c2e3f9-5889544686-l6xbh

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c2e3f9-5797bffc67-tmhgg

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-zldwf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w4-ed012e-openshift-default-6ddfc957bc-lc944

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-4a477d-66d7dcf5d7-l6fzj

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-4a477d-6d8d59f968-skf9n

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-49dwt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-4a477d-openshift-default-66bfdb8649-cj8w4

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-ed012e-6cc8bdf976-z2pfl

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-ed012e-775dc4b9bc-ztnzv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9de872-667c8d977f-tslk7

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9de872-7f6d476d96-p52rp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-txf2f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-8g976

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-67wlc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-g95k8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-9de872-openshift-default-77cf8df555-zv786

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-l5bkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-2d1c71-openshift-default-5dc796b975-89xf2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-c6hjq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-0458df-8458bc48d8-k4x95

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-0458df-59fd997f55-dh6kp

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-a1d55d-openshift-default-6646f694ff-8r55v

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-2d1c71-7b84bb8b7b-slhsc

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-2d1c71-56bb5877f9-cvwvf

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a1d55d-574bc6b555-p7hh9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a1d55d-669c459d8-x2x76

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-extmod-a-ca2cd5-openshift-default-59664bf6df-xqn5s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-8z4g6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-59hsq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-nrbmp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-h4qrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-0458df-openshift-default-7c86d79f79-dxb8h

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-a-ca2cd5-5c94cf4c7f-v9vfk

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-a-ca2cd5-78bfff4676-xdh5j

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

Killing

Stopping container payload-processing

openshift-ingress

horizontal-pod-autoscaler

e2e-extmod-b-f3d6a5-openshift-default

SuccessfulRescale

New size: 7; reason: All metrics below target

openshift-ingress

kubelet

e2e-shared-b-w2-ef6be7-openshift-default-bfc5fb79f-hv6qn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulDelete

Deleted pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-7ttp9

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulDelete

Deleted pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-qlfgx

openshift-ingress

replicaset-controller

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7

SuccessfulDelete

Deleted pod: e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-t8s45

openshift-ingress

deployment-controller

e2e-extmod-b-f3d6a5-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7 from 10 to 7
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-2889dd-6cb9cc4d87-95bwz

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-2889dd-6f44c5c46b-rq9b4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

horizontal-pod-autoscaler

maas-default-gateway-openshift-default

SuccessfulRescale

New size: 6; reason: All metrics below target

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled down replica set maas-default-gateway-openshift-default-68cb9b4b95 from 7 to 6

openshift-ingress

kubelet

maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-68cb9b4b95

SuccessfulDelete

Deleted pod: maas-default-gateway-openshift-default-68cb9b4b95-k9sm4

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-r6lh7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-9wjp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-69568

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-lzq4h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f5ct2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-f486z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ef6be7-b644cdf8c-7ts4v

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-extmod-b-f3d6a5-openshift-default-79b6db5bf7-h9sw7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ef6be7-b5b8d4c6d-cchx6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-lhbs4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-749x9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-g7n5p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-gtdr6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-2889dd-openshift-default-84768d69f7-h627j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-dcd326-76747774b6-v9wmz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-dcd326-755bb5b555-7txnj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-extmod-b-f3d6a5-5c85fcfbff-nxprw

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-processing-e2e-extmod-b-f3d6a5-75b5cb7b4d-grxqv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.207:50052" within 1s: context deadline exceeded
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-rx8d5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-k7bpd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-4w65l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-zsbp2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w2-39bde3-openshift-default-5d45cdbd49-vjhf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-dcd326-openshift-default-d787c4f6f-86bpp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w2-39bde3-79487f87d-hvbtv

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.46:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w2-39bde3-754c6b4995-v6vws

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.132.0.54:50052" within 1s: context deadline exceeded

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-46385c-77fc5b7bb6-lzlpw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-46385c-766578f7d7-q5wjx

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-shared-b-w1-46385c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-shared-b-w1-46385c: Operation cannot be fulfilled on endpoints "payload-processing-e2e-shared-b-w1-46385c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-shared-b-w1-46385c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f9cec312-5a2a-4242-ae35-5668f2bf9ac2, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w1-46385c-openshift-default-6ccdb978d5-4gmh4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-worker-w1-85cb41-openshift-default

ScalingReplicaSet

Scaled down replica set e2e-worker-w1-85cb41-openshift-default-74bfbc4465 from 3 to 2

openshift-ingress

replicaset-controller

e2e-worker-w1-85cb41-openshift-default-74bfbc4465

SuccessfulDelete

Deleted pod: e2e-worker-w1-85cb41-openshift-default-74bfbc4465-kjkjk

openshift-ingress

horizontal-pod-autoscaler

e2e-worker-w1-85cb41-openshift-default

SuccessfulRescale

New size: 2; reason: All metrics below target

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-fz9ck

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w1-85cb41-openshift-default-74bfbc4465-ldpr7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

payload-processing-e2e-worker-w1-85cb41-558557d48b-zm5n6

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w1-85cb41-68854975f5-xlf6x

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.50:50052" within 1s: context deadline exceeded

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

SuccessfulRescale

New size: 3; reason: All metrics below target

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7ddd9cfdc8

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7ddd9cfdc8-wlrxd

openshift-ingress

kubelet

istiod-openshift-gateway-7ddd9cfdc8-wlrxd

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7ddd9cfdc8 from 4 to 3